A privacy-preserving measurement framework.
Clean Insights gives developers a way to plug into a secure, private measurement platform.
It is focused on assisting in answering key questions about app usage patterns, and not on
enabling invasive surveillance of all user habits.
Our approach provides programmatic levers to pull to cater to specific use cases and privacy needs.
It also provides methods for user interactions that are ultimately empowering instead of alienating.
``JavaScript
// Instantiate with configuration.
const ci = CleanInsights({
"server": "http://example.com/ci/cleaninsights.php",
"siteId": 1,
"campaigns": {
"feature1-usage": {
"start": "2021-01-01T00:00:00-00:00",
"end": "2021-12-31T23:59:59-00:00",
"aggregationPeriodLength": 1,
"numberOfPeriods": 90
}
}
})
// Ask for consent:
ci.requestConsentForCampaign("test", ConsentRequestUi())
// Measure a page visit, e.g. in #onload:
ci.measureVisit(["Main"], "test")
// Measure an event (e.g. a button press):
ci.measureEvent("music", "play", "test")
// Make sure to persist the locally cached data. E.g. onunload.`
ci.persist()
Please note: CleanInsights' core concept is a Campaign. Since we don't want you to
record just anything, like all the others do, you need to configure, what your actually interested
in and for how long. For a deeper understanding, please read the Concepts section below.
This project also contains different examples: One for a frontend app, one for a backend Node.js
app and one for simpler websites. Please refer to the
GitLab repository
for a full understanding on how to use this library.
While the general CleanInsights SDK package is designed to be used in apps, with
a lot of freedom for the developer in mind, we also provide a prepackaged,
precompiled version to be used with normal websites:
clean-insights-auto-tracker.js
can just be dropped into any webpage and is used to automatically track page visits.
Additionally, you have a full CleanInsights SDK at hand and can do all the additional
tracking you can do with a normal version, too.
You still will need to provide consent. Check out the
website example
on how to do that in the most basic way.
The CleanInsights SDK has some important anonymizing features, which make the AutoTracker
script less usable in certain circumstances:
Recording is only ever being sent when an aggregation period is over.
(Read the full document to get a better understanding of why.)
For the AutoTracker, that means, users need to visit on at least 2 days, since the
aggregation period for the page visit tracking is 1 day:
- On the first day, consent is given and visits are recorded.
- On the second day, visits of the first day are uploaded.
- (On the third day, visits of the second day will be uploaded, and so forth.)
These days don't need to be consecutive, but nevertheless, you need visitors who
typically return.
That means, for landing pages and other sites which normally aren't visited multiple
times, the CleanInsights AutoTracker isn't useful.
You can instead just use the standard Matomo tracker JavaScript or you could develop
your own thing which works with the CIMP.
CleanInsightsSDK is available through npm.
To install it, execute one of the following commands in your project directory:
`shell`
npm install --save clean-insights-sdkor
yarn add clean-insights-sdk
- Design documents and JSON schema specifications
A measurement is a single call to the SDK to measure a visit or an event.
Measurements are always aggregated immediately and only stored in that aggregated
form, in order to avoid a too high resolution and therefore unnecessary invasion into the users
privacy.
All measurements are done for a specific campaign you need to configure.
Measurements done against an unconfigured campaign are ignored, as well as measurements
done against a campaign which ran out or where the maximum length of days of data gathering
is crossed.
This helps you avoid unwanted measurements with left-over measurement code of older
campaigns.
A campaign has a period during which it is active and a maximum length of days during which
data is gathered for a specific user after they consented to the measurements.
The specific start date of a campaign helps you coordinate campaigns across platforms.
Measurements done before a campaign start are, of course, ignored.
The days during which measurements take place are defined by the aggregation period length
in days and the number of periods.
After a user consented, measurements will start right away for as long as the current measurement
period still goes on.
If you want to even further increase your users' anonymity guarantees and ensure that the first
measured period is a full one, you can configure that with the strengthen_anonymity
configuration option, which will enforce the beginning of measurements only at the next full
aggregation period.
At the end of an aggregation period, the campaign data will be automatically sent to your insights
server.
If you configure a higher numberOfPeriods than 1, the next aggregation period will begin
immediately after the end of the first one and measurement will continue.
#### Events
In Contrast to visit measurements, event measurements support the complete
Matomo Event API.
This means you can also record numeric values, like e.g. time something takes.
You can configure the aggregation method to use, when the same event is recorded multiple
times: Event values can be summed up or an average can be calculated.
This can be configured per campaign.
#### Not a Matomo Campaign
Note the difference to Matomo: CleanInsights' concept of a campaign doesn't map to Matomo's
concept of campaigns, which is mostly about finding out if a marketing campaign (like an advertisement
or a landing page) sent any additional visitors to a website.
You need to ask your users for consent to your measurements.
There are 2 types of consent:
- Campaign consents: Each measurement campaign needs to get consent by the user. You need
to explain to the user what you want to measure, how long you want to measure it and why.
The SDK contains UI to help you with that.
- Common feature consent: Some data is orthogonal to the visits or events you want to measure,
like locale or device type used. Since these features are only ever recorded when doing
measurements for a campaign, consent needs to be gathered only once per user per feature.
A user might want to actively withdraw consent. The SDK supports that. Please make sure that
the user can actually do that.
The SDK provides UI to help you with that.
To make sure your CleanInsights configuration is valid, you can use our
JSON scheme to validate against.
Here's an online validator
A complete documentation
is generated from that JSON scheme.
CleanInsights SDK currently supports Matomo as a backend via
CIMP.
If you use this on the server side, we recommend to do only anonymous measurements.
That means, you should not measure anything which contains identifying information.
In that case, you won't need to ask anybody for consent, and you can make use of
the serverSideAnonymousUsage configuration option.
Check out the backend example on how to configure the SDK and how
to implement storage and upload to CIMP.
If you want to use this in a Chrome extension, you can find an example implementation
and a usable store for chrome.storage.local` in the
example_chrome_extension folder.
If you want to use this in React Native, you can find an example implementation
of a suitable store in this example project.
Benjamin Erhart, berhart@netzarchitekten.com for the Guardian Project
CleanInsightsSDK is available under the MIT license. See the LICENSE file for more info.