Conversation
|
@m-appel thanks for opening this. Do you think you can add some text to this PR with a brief description of:
Thanks! |
|
Sure, I guess it's better for public documentation. We are applying for access to better integrate OONI data into the Internet Yellow Pages. "We" is Malte Tashiro and Romain Fontugne from the IIJ Research Laboratory (also running the Internet Health Report). The Internet Yellow Pages (GitHub) is a knowledge graph that combines Internet-related datasets. We are already integrating OONI data via crawlers that use the AWS buckets, but since we fetch one week of data every week our build machine reaches its limits, especially for the webconnectivity test data. We do not need the entire raw data provided in the AWS buckets, so we hope to make the process more efficient by accessing the Clickhouse instance. |
No description provided.