Skip to content

Add tests for DataFusion base classes - #71983

Open
zhangxinyao88 wants to merge 1 commit into
apache:mainfrom
zhangxinyao88:codex/airflow-35442-datafusion-base-tests
Open

Add tests for DataFusion base classes#71983
zhangxinyao88 wants to merge 1 commit into
apache:mainfrom
zhangxinyao88:codex/airflow-35442-datafusion-base-tests

Conversation

@zhangxinyao88

Copy link
Copy Markdown

Add focused tests for the Common SQL DataFusion base abstractions:

  • cover bucket extraction from valid and invalid object-storage paths
  • verify format handlers retain their data-source configuration
  • verify the DataFusion exception types share the expected Airflow exception hierarchy

Remove the corresponding entries from OVERLOOKED_TESTS now that both test modules exist.

related: #35442

Testing:

  • breeze run pytest providers/common/sql/tests/unit/common/sql/datafusion/test_base.py providers/common/sql/tests/unit/common/sql/datafusion/test_exceptions.py -xvs
  • breeze run pytest airflow-core/tests/unit/always/test_project_structure.py::TestProjectStructure::test_providers_modules_should_have_tests -xvs
  • Airflow pre-commit and commit-message hooks

Was generative AI tooling used to co-author this PR?
  • Yes (Codex)

Generated-by: Codex following the guidelines


Drafted-by: Codex GPT-5; reviewed by @zhangxinyao88 before posting

Cover object-store bucket parsing, format-handler configuration, and the DataFusion exception hierarchy while removing their project-structure exemptions.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant