spark pyspark使用

🧙 Questions

使用pySpark

☄️ Ideas

pip show pyspark
spark-submit --version
pip3 install pyspark==2.4.0
bash的远程命令执行/python的远程命令执行
python3 -m pip install pyspark
需要下载一个对应的spark的tar.gz 的pyspark包
pip3 install 
https://archive.apache.org/dist/spark/spark-3.4.1/
http://mirrors.cloud.aliyuncs.com/pypi/packages/11/96/85b392e2564b69256b1d5360dd7d9e5428ea381623df590cfb45f3ea5432/pyspark-3.2.4.tar.gz
http://mirrors.cloud.aliyuncs.com/pypi/packages/86/ec/60880978512d5569ca4bf32b3b4d7776a528ecf4bca4523936c98c92a3c8/py4j-0.10.9.5-py2.py3-none-any.whl

🔗 Links

• spark docs