Skip to content

Latest commit

 

History

History
 
 

dev

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
create-release
create-release
 
 
deps
deps
 
 
infra
infra
 
 
spark-test-image-util/docs
spark-test-image-util/docs
 
 
spark-test-image
spark-test-image
 
 
sparktestsupport
sparktestsupport
 
 
.rat-excludes
.rat-excludes
 
 
.scalafmt.conf
.scalafmt.conf
 
 
README.md
README.md
 
 
change-scala-version.sh
change-scala-version.sh
 
 
check-license
check-license
 
 
check-protos.py
check-protos.py
 
 
check_pyspark_custom_errors.py
check_pyspark_custom_errors.py
 
 
checkstyle-suppressions.xml
checkstyle-suppressions.xml
 
 
checkstyle.xml
checkstyle.xml
 
 
connect-gen-protos.sh
connect-gen-protos.sh
 
 
connect-jvm-client-mima-check
connect-jvm-client-mima-check
 
 
eslint.js
eslint.js
 
 
free_disk_space
free_disk_space
 
 
free_disk_space_container
free_disk_space_container
 
 
gen-protos.sh
gen-protos.sh
 
 
is-changed.py
is-changed.py
 
 
java-file-header
java-file-header
 
 
lint-java
lint-java
 
 
lint-js
lint-js
 
 
lint-python
lint-python
 
 
lint-r
lint-r
 
 
lint-r.R
lint-r.R
 
 
lint-scala
lint-scala
 
 
make-distribution.sh
make-distribution.sh
 
 
merge_spark_pr.py
merge_spark_pr.py
 
 
mima
mima
 
 
package-lock.json
package-lock.json
 
 
package.json
package.json
 
 
pip-sanity-check.py
pip-sanity-check.py
 
 
protobuf-breaking-changes-check.sh
protobuf-breaking-changes-check.sh
 
 
py-cleanup
py-cleanup
 
 
pyproject.toml
pyproject.toml
 
 
reformat-python
reformat-python
 
 
requirements.txt
requirements.txt
 
 
run-pip-tests
run-pip-tests
 
 
run-tests
run-tests
 
 
run-tests.py
run-tests.py
 
 
sbt-checkstyle
sbt-checkstyle
 
 
scalafmt
scalafmt
 
 
scalastyle
scalastyle
 
 
streaming-gen-protos.sh
streaming-gen-protos.sh
 
 
structured_logging_style.py
structured_logging_style.py
 
 
test-dependencies.sh
test-dependencies.sh
 
 
tox.ini
tox.ini
 
 

README.md

Spark Developer Scripts

This directory contains scripts useful to developers when packaging, testing, or committing to Spark.

Many of these scripts require Apache credentials to work correctly.