yvachot/PySpark_Training_Repository
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
No description
7 commits 1 branch 0 tags 49 KiB
Find a file
Yûki VACHOT e28c446569 Add env python for Spark
2024-01-11 14:01:57 +01:00
.idea Add env python for Spark 2024-01-11 14:01:57 +01:00
assets/output_dataset_1/raw Add RAW data with new architecture 2024-01-09 17:11:23 +01:00
src Add env python for Spark 2024-01-11 14:01:57 +01:00
.gitignore Init 2024-01-05 13:05:39 +01:00
.pylintrc Add env python for Spark 2024-01-11 14:01:57 +01:00
example_test.py Init PyTest 2024-01-05 17:10:52 +01:00
init.py Add env python for Spark 2024-01-11 14:01:57 +01:00
README.md Add env python for Spark 2024-01-11 14:01:57 +01:00
requirements.txt Add env python for Spark 2024-01-11 14:01:57 +01:00
spark_check.py Add env python for Spark 2024-01-11 14:01:57 +01:00

README.md

Python PySpark Training Repository

Author: Yûki VACHOT

Updated: 10/01/24

CONTENT TABLE

Installation

python -m venv

Run Python PySpark

  • python init.py

Run Python Test

  • path from src/test_pyspark_training
  • pytest -k test_

Run pylint for code check

Run Python doc with Sphinx