From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by sourceware.org (Postfix) with ESMTPS id DDF74385840F for ; Thu, 7 Apr 2022 16:42:14 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org DDF74385840F Received: from mimecast-mx02.redhat.com (mx3-rdu2.redhat.com [66.187.233.73]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-235-gHObB21jNj-RYWAq-t2r0Q-1; Thu, 07 Apr 2022 12:42:11 -0400 X-MC-Unique: gHObB21jNj-RYWAq-t2r0Q-1 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.rdu2.redhat.com [10.11.54.4]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx02.redhat.com (Postfix) with ESMTPS id 258DA1C04B48; Thu, 7 Apr 2022 16:42:11 +0000 (UTC) Received: from [10.2.18.31] (unknown [10.2.18.31]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 0EBA42024CB9; Thu, 7 Apr 2022 16:42:07 +0000 (UTC) Message-ID: <6f95aa68-518a-73ca-a4c3-26ae2e2100f3@redhat.com> Date: Thu, 7 Apr 2022 09:42:04 -0700 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Subject: Re: bunsen (re)design discussion #1: testrun & branch identifiers, testrun representation To: Serhei Makarov , "Frank Ch. Eigler" Cc: Bunsen References: <320ed3c9-2612-4f64-bb1a-6a791bef4168@www.fastmail.com> <20220310180414.GC28310@redhat.com> <34fdccc3-5756-492a-89b9-3a2cab65b16a@www.fastmail.com> <87ee39fm51.fsf@redhat.com> <813163ee-3ab5-462c-b2b2-475f77bc3ab1@www.fastmail.com> From: Keith Seitz In-Reply-To: <813163ee-3ab5-462c-b2b2-475f77bc3ab1@www.fastmail.com> X-Scanned-By: MIMEDefang 2.78 on 10.11.54.4 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Language: en-US Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-7.0 required=5.0 tests=BAYES_00, DKIMWL_WL_HIGH, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, NICE_REPLY_A, RCVD_IN_DNSWL_LOW, RCVD_IN_MSPIKE_H4, RCVD_IN_MSPIKE_WL, SPF_HELO_NONE, SPF_NONE, TXREP, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on server2.sourceware.org X-BeenThere: bunsen@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Bunsen mailing list List-Unsubscribe: , List-Archive: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Apr 2022 16:42:22 -0000 On 3/14/22 10:24, Serhei Makarov wrote: > Given the weak correspondence between Testrun/Testcase objects, we end > up needing a set of explicit ser/de methods under the hood, just as > with the JSON representation. In Sept 2020, I played with this a bit, and I have old (probably stale) patches lying around to let SQLite do the serialization. The patches do nothing to replace the JSON or the presented data model. I reported my initial findings here: https://sourceware.org/pipermail/bunsen/2020q3/000034.html If you'd like to peek at that work, I can send it along, but it is probably quite bit-rot by now. > My current understanding of the schema would be as follows: > > - testruns (testrun_id, project, testlogs_commit_id) > - ANALYSIS_testrun_kvs (testrun_id, key, value) > - For analysis results that annotate the original testrun. > - testrun_kv_types (project, key, schema) > - We will probably need to store some 'schema' information like this. > - testcases (testrun_id, name, outcome, subtest_id) > - subtest_strs (subtest_id, subtest_text) > > According to your vision, there would also need to be additional > tables for analysis results which don't follow the format of testrun > key-value annotations. Not relevant just yet, and we may need to > decide a different schema for each category of analysis (diff, grid > view, regression report, etc.). I have a prototype schema just to record test data. Bunsen's git repo is still used to store the actual .sum/.log files and provide commit IDs to identify a particular testrun, i.e., no bunsne metadata. Keith