yvachot/PySpark_Training_Repository
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Init README

Browse source
This commit is contained in:
Yûki VACHOT 2024-01-08 09:24:48 +01:00
parent 25c2e6b7cb
commit 1f9509c574
1 changed files with 13 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

13
README.md Normal file
View file

@ -0,0 +1,13 @@
# Python PySpark Training Repository
## Installation
- [Python 3.10](https://www.python.org/downloads/)
- pyspark=3.1.1
- [Spark 3.1.1](https://spark.apache.org/downloads.html)
- [Hadoop 3.3.6](https://hadoop.apache.org/releases.html)
- [Java JDK 11](https://www.oracle.com/java/technologies/downloads/#java11)
- (not mandatory) [Anaconda for conda](https://www.anaconda.com/download/)
## Run Python Test
- path from src/test_pyspark_training
- `pytest -k test_`