yvachot/PySpark_Training_Repository
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

PipeGraph Decorator

Browse source
This commit is contained in:
Yûki VACHOT 2024-01-12 17:28:45 +01:00
parent e28c446569
commit 8f6699ecc6
14 changed files with 357 additions and 136 deletions
Download patch file Download diff file Expand all files Collapse all files

2
README.md
View file

@ -15,6 +15,8 @@ Python PySpark Training Repository
- [Spark 3.5.0 with Hadoop 3.0.0](https://spark.apache.org/downloads.html)
- [winutils.exe, .pdb and hadoop.dll](https://github.com/steveloughran/winutils/tree/master/hadoop-3.0.0/bin)
- [Java JDK 17](https://www.azul.com/downloads/?version=java-17-lts&package=jdk#zulu)
- [pygraphviz](https://pygraphviz.github.io/documentation/stable/install.html#windows) install in x86
- `pip install --global-option=build_ext --global-option="-IC:\Program Files (x86)\Graphviz\include" --global-option="-LC:\Program Files (x86)\Graphviz\lib" pygraphviz`
---
# Run Python PySpark
- `python init.py`