Re: Kcidb access request

On Thu, Aug 08, 2024 at 08:56:12PM GMT, Nikolai Kondrashov wrote:
> Hi Bjorn,
> 
> On 8/7/24 6:49 PM, Bjorn Andersson wrote:
> > I'm using api.kernelci.org for reporting test results from my kernelci
> > lab, as well as scraping test reports for Qualcomm boards for local
> > aggregation and presentation.
> > 
> > As part of the transition to the new KernelCI APIs, I would like access
> > to KCIDB.
> > 
> > 
> > My (custom) test reporting tool today uses the LAVA callback interface,
> > and thereby follows this schema for the report, groups and cases. I can
> > continue to follow this schema, or change the schema as you prefer.
> > Please let me know.
> 
> Sorry for the delay with the answer!
> 
> Sure, you can get the access to the KCIDB database.
> 
> However, we don't have APIs, just the direct access to PostgreSQL, which keeps
> six months of data. See the attached (abbreviated) schema dump. It largely
> mirrors the JSON I/O schema, which you can see here:
> 
> https://github.com/kernelci/kcidb-io/blob/main/kcidb_io/schema/v04_03.py
> 

The guide talks about PubSub interface, perhaps I'm misunderstanding
this portion?

No real concern with the direct SQL interface.

> Here's some more human-oriented introductory docs:
> 
> https://kernelci.org/docs/kcidb/submitter_guide/
> 

Thank you (and thanks Gustavo for the updated link).

> Note, that at the moment we have no way to query for "Qualcomm boards", but we
> have a schema change proposal being discussed to address that.
> 

How do you associate device-specific tests (or any test that pass/fail
due to device-specific regressions) with a particular device then?

> Also, when fetching your data you will need to be considerate of traffic and load.
> 

Understood. No concerns here.

> You can explore the data on the dashboard (to be improved soon):
> https://kcidb.kernelci.org/
> 
> If none of the above stops you, I can give you credentials and permissions for
> querying.
> 

That would be great, and would allow me to make an attempt to tie this
into my local dashboard...

Regards,
Bjorn