Release to the Release Branch by sgoggins · Pull Request #3616 · augurlabs/augur

sgoggins · 2026-01-21T00:21:58Z

Description

Substantial Release PR.

/ Goggins

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>

Add two new tables and ORM models for Topic Modeling versioning system: 1. topic_model_meta table (Migration 35): - Stores metadata for each trained topic model - 21 fields including model_id (UUID PK), repo_id (FK), training parameters, quality metrics (coherence_score, topic_diversity), and visualization data - Enables model versioning, comparison, and intelligent retraining 2. topic_model_event table (Migration 36): - Audit log for topic modeling events - Tracks training lifecycle: started, completed, retrain triggered, etc. - Provides observability for automated and manual training operations 3. TopicModelMeta ORM model: - SQLAlchemy model definition for topic_model_meta table - Relationships and field mappings for application layer These schema changes support the Topic Modeling feature that enables: - Automated NMF-based topic extraction from repository messages - Model version management and comparison - Intelligent retraining based on data/quality changes - Storage optimization via REPLACE strategy for automatic runs Related: #3207 Signed-off-by: Xiaoha <blairjade183@gmail.com>

Signed-off-by: Shlok Gilda <gildashlok@hotmail.com>

- All JSON/JSONB fields in Augur have NO indexes - Verified: repo_badging.data (JSONB), chaoss_metric_status.cm_info (JSON), etc. - payload is used for display, not filtering - Query performance relies on ix_tme_repo_ts and ix_tme_event indexes Signed-off-by: Xiaoha <blairjade183@gmail.com>

Signed-off-by: Shlok Gilda <gildashlok@hotmail.com>

…ockers log stream Signed-off-by: Adrian Edwards <adredwar@redhat.com>

- set training_start_time/end_time/data_collection_date to TIMESTAMPTZ - update TopicModelMeta ORM to use timezone-aware columns - align topic_model_event ts column with TIMESTAMPTZ requirement - satisfies maintainer request for timezone data storage Signed-off-by: Xiaoha <blairjade183@gmail.com>

- switch Alembic migrations to use sa.TIMESTAMP(timezone=True) - keeps timezone support while avoiding Postgres-specific type import Signed-off-by: Xiaoha <blairjade183@gmail.com>

…typos Fix typos in test directory names (fixes #3398)

feat: Add Topic Modeling database schema tables

- add csv_utils.py with intelligent header detection - refactor add-repos and add-repo-groups commands to use new CSV parser - support both header and headerless CSV formats - add automatic column detection for headerless CSVs - add 10MB file size limit with clear error message - update sample CSV files to include headers Fixes #3310 Signed-off-by: Shlok Gilda <gildashlok@hotmail.com>

Signed-off-by: Shlok Gilda <gildashlok@hotmail.com>

…in cli Signed-off-by: Shlok Gilda <gildashlok@hotmail.com>

…error handling Signed-off-by: Shlok Gilda <gildashlok@hotmail.com>

Signed-off-by: Shlok Gilda <gildashlok@hotmail.com>

Migration 36 created the topic_model_event table in the database, but the corresponding SQLAlchemy model was not added to augur_data.py. This caused ORM-level access to the event table to fail. This commit adds the TopicModelEvent class with: - All table columns (event_id, ts, repo_id, model_id, event, level, payload) - Index definitions for ix_tme_repo_ts and ix_tme_event - Foreign key constraints to repo and topic_model_meta tables - Relationship mappings to Repo and TopicModelMeta models This enables the application to query and manipulate topic modeling events through the ORM layer. Related: augur/application/schema/alembic/versions/36_add_topic_model_event.py Signed-off-by: Xiaoha <blairjade183@gmail.com>

Ensure repo_id column type matches migration definition (sa.Integer) for complete schema consistency between ORM and database. Signed-off-by: Xiaoha <blairjade183@gmail.com>

Add TopicModelEvent ORM model to augur_data.py

…clients Fix database connection leak when deleting repos via web UI: Fixes #3392 Discussed in maintainers meeting. Solution validated and ready for testing.

Ensure Docker logging facilities can see gunicorn errors. small change with well understood effects, so merging.

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

Signed-off-by: PredictiveManish <manish.tiwari.09@zohomail.in>

… clarity Signed-off-by: Adeeba Nizam <adeebanizam63@gmail.com>

Create a migration to synchronize the topic model tables. This fix was discussed in Maintainers meetings and is being merged.

… config file Signed-off-by: Adrian Edwards <adredwar@redhat.com>

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

Signed-off-by: Adrian Edwards <17362949+MoralCode@users.noreply.github.com>

…ed-processing [tasks/github] Batch processing for PR review comments collection

Fix config hierarchy

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

using pytest avoids two layers of python environment "the gap between task runners like tox and test runners like pytest is narrower now" - Gemini Signed-off-by: Adrian Edwards <adredwar@redhat.com>

Signed-off-by: pushpit kamboj <pushpitkamboj@gmail.com>

Signed-off-by: iGufrankhan <gufrankhankab123@gmail.com>

(fix): remove no else raise and no else return rules from .pylintrc

Signed-off-by: Adrian Edwards <17362949+MoralCode@users.noreply.github.com>

…tview Remove stale explorer_libyear_detail refresh from matview script

Signed-off-by: Noaman-Akhtar <akhtarnoaman@gmail.com>

Signed-off-by: Adrian Edwards <17362949+MoralCode@users.noreply.github.com>

add CI job for running the unit tests

…sql.schema Deleted the augur-retired-sql.schema file

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

…iases table Signed-off-by: Adrian Edwards <adredwar@redhat.com>

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

Fixes for repo url update on move detection

Revert database url retrieval so manual install works

Signed-off-by: Sean P. Goggins <s@goggins.com>

🐛 fixes

github-actions · 2026-01-21T00:22:32Z

 from sqlalchemy import and_, update
 import json
+import copy
 from typing import List, Any, Optional


[pylint] _{reported by reviewdog 🐶}
W0611: Unused List imported from typing (unused-import)

github-actions · 2026-01-21T00:22:33Z

+            max_rev = max(max_rev, int(m.group(1)))
+    return str(max_rev + 1)
+
+def process_revision_directives(context, revision, directives):


[pylint] _{reported by reviewdog 🐶}
W0621: Redefining name 'context' from outer scope (line 4) (redefined-outer-name)

github-actions · 2026-01-21T00:22:33Z

@@ -1,7 +1,7 @@
 import pytest


[pylint] _{reported by reviewdog 🐶}
W0611: Unused import pytest (unused-import)

github-actions · 2026-01-21T00:22:33Z

@@ -5,7 +5,7 @@

 from augur.application.db.session import DatabaseSession
 from augur.tasks.github.util.github_task_session import GithubTaskSession


[pylint] _{reported by reviewdog 🐶}
W0611: Unused GithubTaskSession imported from augur.tasks.github.util.github_task_session (unused-import)

github-actions · 2026-01-21T00:22:33Z

@@ -1,7 +1,7 @@
 import pytest


[pylint] _{reported by reviewdog 🐶}
W0611: Unused import pytest (unused-import)

github-actions · 2026-01-21T00:22:34Z

+    dummyPersistent.enrich_data_primary_keys(sample_source_data_enriched, tableDict['contributors_table'], gh_merge_fields, augur_merge_fields)

    #now test each record to make sure that they have an avatar_url
    avatar_url_sql = s.sql.text("""


[pylint] _{reported by reviewdog 🐶}
E0602: Undefined variable 's' (undefined-variable)

github-actions · 2026-01-21T00:22:34Z

+    assert dummyPersistent.enrich_data_primary_keys(None, "contributors_table", gh_merge_fields, augur_merge_fields) == None


 def test_enrich_data_primary_keys_redundant_enrich(database_connection,sample_source_data_enriched, sample_source_data_unenriched):


[pylint] _{reported by reviewdog 🐶}
W0621: Redefining name 'database_connection' from outer scope (line 3) (redefined-outer-name)

github-actions · 2026-01-21T00:22:34Z

+    assert dummyPersistent.enrich_data_primary_keys(None, "contributors_table", gh_merge_fields, augur_merge_fields) == None


 def test_enrich_data_primary_keys_redundant_enrich(database_connection,sample_source_data_enriched, sample_source_data_unenriched):


[pylint] _{reported by reviewdog 🐶}
W0621: Redefining name 'sample_source_data_enriched' from outer scope (line 3) (redefined-outer-name)

github-actions · 2026-01-21T00:22:34Z

+    assert dummyPersistent.enrich_data_primary_keys(None, "contributors_table", gh_merge_fields, augur_merge_fields) == None


 def test_enrich_data_primary_keys_redundant_enrich(database_connection,sample_source_data_enriched, sample_source_data_unenriched):


[pylint] _{reported by reviewdog 🐶}
W0621: Redefining name 'sample_source_data_unenriched' from outer scope (line 3) (redefined-outer-name)

github-actions · 2026-01-21T00:22:34Z

+    dummyPersistent.enrich_data_primary_keys(sample_source_data_enriched, tableDict['contributors_table'], gh_merge_fields, augur_merge_fields)

    #now test each record to make sure that they have an avatar_url
    avatar_url_sql = s.sql.text("""


[pylint] _{reported by reviewdog 🐶}
E0602: Undefined variable 's' (undefined-variable)

MoralCode and others added 30 commits October 24, 2025 10:49

remove unused functions

99fc30c

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

add toggle option for messages

e080f61

Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>

fix typos in the tests folder.

d40e9ac

Signed-off-by: Shlok Gilda <gildashlok@hotmail.com>

fix incorrect path for worker persistence in pytest configuration

a96e62f

Signed-off-by: Shlok Gilda <gildashlok@hotmail.com>

Detect docker environments and ensure gunicorn error logs end up in d…

c642462

…ockers log stream Signed-off-by: Adrian Edwards <adredwar@redhat.com>

chore: rely on SQLAlchemy TIMESTAMP type with timezone

aa67f9b

- switch Alembic migrations to use sa.TIMESTAMP(timezone=True) - keeps timezone support while avoiding Postgres-specific type import Signed-off-by: Xiaoha <blairjade183@gmail.com>

Merge pull request #3399 from shlokgilda/feature/issue-3398-fix-test-…

5248b07

…typos Fix typos in test directory names (fixes #3398)

Merge pull request #3397 from xiaoha-cloud/topic-modeling-schema-only

6b48ab6

feat: Add Topic Modeling database schema tables

remove header rows from test CSV files for repo groups and repos

b2d0614

Signed-off-by: Shlok Gilda <gildashlok@hotmail.com>

improve CSV processing error handling and logging in db commands

515adc1

Signed-off-by: Shlok Gilda <gildashlok@hotmail.com>

enhance type annotations and docstrings for CSV processing functions …

b42333f

…in cli Signed-off-by: Shlok Gilda <gildashlok@hotmail.com>

add unit tests for CSV processing utilities including validation and …

9fff7d8

…error handling Signed-off-by: Shlok Gilda <gildashlok@hotmail.com>

move RepoLoadController within the database session context

15b2dcc

Signed-off-by: Shlok Gilda <gildashlok@hotmail.com>

Add explicit Integer type to repo_id column

2f83a2e

Ensure repo_id column type matches migration definition (sa.Integer) for complete schema consistency between ORM and database. Signed-off-by: Xiaoha <blairjade183@gmail.com>

Merge pull request #3405 from xiaoha-cloud/topic-modeling-schema-only

1c0247d

Add TopicModelEvent ORM model to augur_data.py

Merge pull request #3400 from shlokgilda/feature/issue-3392-too-many-…

74da538

…clients Fix database connection leak when deleting repos via web UI: Fixes #3392 Discussed in maintainers meeting. Solution validated and ready for testing.

Merge pull request #3389 from chaoss/gunicorn-errors

6475b63

Ensure Docker logging facilities can see gunicorn errors. small change with well understood effects, so merging.

Create a migration to synchronize the topic model tables

6a406fd

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

Fix: collection_intervals into seconds

17963e4

Signed-off-by: PredictiveManish <manish.tiwari.09@zohomail.in>

Merge branch 'chaoss:main' into docs-collection

016ad79

docs: move contributor lists to CONTRIBUTORS.md and update README for…

a969423

… clarity Signed-off-by: Adeeba Nizam <adeebanizam63@gmail.com>

Merge pull request #3408 from chaoss/migrate-topic-models-2

d704670

Create a migration to synchronize the topic model tables. This fix was discussed in Maintainers meetings and is being merged.

connect up the url in another place to prevent errors about a missing…

95b2b78

… config file Signed-off-by: Adrian Edwards <adredwar@redhat.com>

install python-dotenv

d78f5dc

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

load from .env

8f7368f

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

MoralCode and others added 25 commits January 6, 2026 15:52

remove path tracking

155186f

Signed-off-by: Adrian Edwards <17362949+MoralCode@users.noreply.github.com>

Merge pull request #3449 from shlokgilda/fix/pr-review-comments-batch…

b270c8f

…ed-processing [tasks/github] Batch processing for PR review comments collection

Merge pull request #3512 from chaoss/bugs/config-hierarchy

99aacb8

Fix config hierarchy

fix test for retrieving the correct dict

64ad1a5

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

add and fix test case for verifying write protection for the JSON config

b5920e1

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

add CI job for running the unit tests with pytest

0fb462a

using pytest avoids two layers of python environment "the gap between task runners like tox and test runners like pytest is narrower now" - Gemini Signed-off-by: Adrian Edwards <adredwar@redhat.com>

(fix): remove no else raise and no else return rules from .pylintrc

76b7ceb

Signed-off-by: pushpit kamboj <pushpitkamboj@gmail.com>

Remove stale explorer_libyear_detail refresh

53eed1a

Signed-off-by: iGufrankhan <gufrankhankab123@gmail.com>

Merge pull request #3533 from pushpitkamboj/fix_linter_config

f895f07

(fix): remove no else raise and no else return rules from .pylintrc

Revert database url retrieval so bare metal works

22f81b5

Signed-off-by: Adrian Edwards <17362949+MoralCode@users.noreply.github.com>

unused os import

4105906

Signed-off-by: Adrian Edwards <17362949+MoralCode@users.noreply.github.com>

Disable tests for 3.12+ so they work

43aaf92

Signed-off-by: Adrian Edwards <17362949+MoralCode@users.noreply.github.com>

Merge pull request #3540 from iGufrankhan/fix/remove-stale-libyear-ma…

79797e6

…tview Remove stale explorer_libyear_detail refresh from matview script

Deleted the augur-retired-sql.schema file

4e2d014

Signed-off-by: Noaman-Akhtar <akhtarnoaman@gmail.com>

add timeout value for the job

d0da031

Signed-off-by: Adrian Edwards <17362949+MoralCode@users.noreply.github.com>

Merge pull request #3513 from chaoss/ntdn/functional-tests

946abed

add CI job for running the unit tests

Merge pull request #3553 from Noaman-Akhtar/Fix/delete-augur-retired-…

7122c73

…sql.schema Deleted the augur-retired-sql.schema file

First draft of new database table for repo_aliases

c43b2f3

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

add code in update_repo_with_dict that adds values to the new repo_al…

4c9244a

…iases table Signed-off-by: Adrian Edwards <adredwar@redhat.com>

seems like retry needs a value passed into it.

1e7a26d

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

Add migration for new table

e05bcce

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

Merge pull request #3391 from chaoss/move_detection

8ec768d

Fixes for repo url update on move detection

Merge pull request #3516 from chaoss/fix/alembic-url

9bca2c2

Revert database url retrieval so manual install works

updated metadata

0592017

Signed-off-by: Sean P. Goggins <s@goggins.com>

Merge pull request #3615 from chaoss/version_bump_93

3bf5ca0

🐛 fixes

sgoggins added the release Related to releasing a new version of Augur label Jan 21, 2026

github-actions bot reviewed Jan 21, 2026

View reviewed changes

sgoggins self-assigned this Jan 21, 2026

sgoggins added this to the v0.92.0 Release milestone Jan 21, 2026

sgoggins merged commit 0249019 into release Jan 21, 2026
27 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Release to the Release Branch#3616

Release to the Release Branch#3616
sgoggins merged 148 commits intoreleasefrom
main

sgoggins commented Jan 21, 2026

Uh oh!

github-actions bot Jan 21, 2026

Uh oh!

github-actions bot Jan 21, 2026

Uh oh!

github-actions bot Jan 21, 2026

Uh oh!

github-actions bot Jan 21, 2026

Uh oh!

github-actions bot Jan 21, 2026

Uh oh!

github-actions bot Jan 21, 2026

Uh oh!

github-actions bot Jan 21, 2026

Uh oh!

github-actions bot Jan 21, 2026

Uh oh!

github-actions bot Jan 21, 2026

Uh oh!

github-actions bot Jan 21, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

13 participants

		@@ -5,7 +5,7 @@

		from augur.application.db.session import DatabaseSession
		from augur.tasks.github.util.github_task_session import GithubTaskSession

		assert dummyPersistent.enrich_data_primary_keys(None, "contributors_table", gh_merge_fields, augur_merge_fields) == None


		def test_enrich_data_primary_keys_redundant_enrich(database_connection,sample_source_data_enriched, sample_source_data_unenriched):

Conversation

sgoggins commented Jan 21, 2026

Uh oh!

github-actions bot Jan 21, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions bot Jan 21, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions bot Jan 21, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions bot Jan 21, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions bot Jan 21, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions bot Jan 21, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions bot Jan 21, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions bot Jan 21, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions bot Jan 21, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions bot Jan 21, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

13 participants