GHA CI

Intel Extension for Transformers use Github Action (GHA) for CI test, if you are new to GHA, please refer to GHA

Test Scope

TestName	Test Cover Path
Format Scan	intel_extension_for_transformers/** workflows/** setup.py .github/workflows/format_scan.yml .github/workflows/script/formatScan/**
Spell Check	ALL
Copyright Check	intel_extension_for_transformers/** setup.py .github/workflows/format_scan.yml
DCO	ALL (use commit -s -m"...")
UT + Coverage (Optimize)	intel_extension_for_transformers/transformers/** intel_extension_for_transformers/utils/** intel_extension_for_transformers/transformers/llm/evaluation/** intel_extension_for_transformers/transformers/llm/quantization/** tests/** .github/workflows/unit-test-optimize.yml .github/workflows/script/unitTest/**
UT + Coverage (Backend)	".github/workflows/unit-test-engine.yml" .github/workflows/script/unitTest/** intel_extension_for_transformers/transformers/runtime/** !intel_extension_for_transformers/transformers/runtime/kernels/** !intel_extension_for_transformers/transformers/llm/runtime/neural_speed/** !intel_extension_for_transformers/transformers/runtime/third_party/** !intel_extension_for_transformers/transformers/runtime/docs/**
UT + Coverage (NeuralChat)	intel_extension_for_transformers/neural_chat/tests/** .github/workflows/unit-test-neuralchat.yml
Kernel gtest	intel_extension_for_transformers/transformers/llm/library/kernels/** .github/workflows/unit-test-kernel.yml .github/workflows/script/unitTest/** !intel_extension_for_transformers/transformers/llm/library/kernels/docs/** !intel_extension_for_transformers/transformers/llm/runtime/neural_speed/** !intel_extension_for_transformers/transformers/llm/library/kernels/README.md
Kernel Benchmark	intel_extension_for_transformers/transformers/llm/library/kernels/** intel_extension_for_transformers/transformers/runtime/test/kernels/benchmark/** .github/workflows/sparse_lib_CI.yml' '.github/workflows/script/SparseLibCI !intel_extension_for_transformers/transformers/llm/library/kernels/docs/** !intel_extension_for_transformers/transformers/llm/library/kernels/README.md
BERT Model Test (Pytorch/Tensorflow)	intel_extension_for_transformers/transformers/** intel_extension_for_transformers/transformers/llm/evaluation/** intel_extension_for_transformers/utils/** intel_extension_for_transformers/transformers/** .github/workflows/optimize-test.yml .github/workflows/script/models/run_optimize.sh
BERT Model Test (LLM Runtime)	.github/workflows/deploy-test.yml .github/workflows/script/models/run_deploy.sh intel_extension_for_transformers/transformers/runtime/** !intel_extension_for_transformers/transformers/runtime/kernels/** !intel_extension_for_transformers/transformers/runtime/test/** !intel_extension_for_transformers/transformers/llm/runtime/neural_speed/** !intel_extension_for_transformers/transformers/runtime/third_party/** !intel_extension_for_transformers/transformers/runtime/docs/**
LLM Model Test (LLM Runtime)	.github/workflows/llm-test.yml .github/workflows/script/models/run_llm.sh intel_extension_for_transformers/transformers/runtime/** !intel_extension_for_transformers/transformers/runtime/kernels/** !intel_extension_for_transformers/transformers/runtime/graph/** !intel_extension_for_transformers/transformers/runtime/test/** !intel_extension_for_transformers/transformers/runtime/third_party/** !intel_extension_for_transformers/transformers/runtime/docs/**
LLM Runtime CPP Graph Test	.github/workflows/cpp-graph-test.yml .github/workflows/script/models/cpp_graph_inference.sh intel_extension_for_transformers/transformers/llm/runtime/neural_speed/** !intel_extension_for_transformers/transformers/llm/runtime/neural_speed/README.md
NeuralChat Workflow Test	.github/workflows/script/chatbot/** .github/workflows/sample_data/** intel_extension_for_transformers/** workflows/chatbot/inference/** .github/workflows/chatbot-test.yml

Test Scripts

If you want to run tests locally, please refer to test yml and corresponding scripts.

Test Name	Test Yml	Scripts Location
Format Scan	format_scan.yml	bandit/cpplint/pylint/cloc/clandformat
SpellCheck	py-spelling.yml	spell check
Unit Test	unit-test-optimize.yml unit-test-engine.yml unit-test-kernel.yml unit-test-neuralchat	unit-test
Model Test	optimize-test deploy-test llm-test.yml cpp-graph-test.yml	model-test
Kernel Benchmark	sparse_lib_CI.yml	kernel-benchmark
NeuralChat Workflows	chatbot-test.yml	chatbot
Copyright Check	copyright_check.yml	N/A