D
D
denislysenko2021-12-15 21:50:09
Apache Spark
denislysenko, 2021-12-15 21:50:09

How to remove this error?

looks like a file

import findspark
findspark.init()
import pyspark
sc = pyspark.SparkContext(appName="myAppName")

rdd = sc.textFile('movies.csv')
print(rdd.take(5))


when I type in console python3 get-movies.py it

says [email protected] homework6 % python3 get-movies.py
21/12/15 20:27:21 WARN Utils: Your hostname, MacBook-Pro-Denis. local resolves to a loopback address: 127.0.0.1; using 192.168.0.103 instead (on interface en0)
21/12/15 20:27:21 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
21/12/15 20:27:22 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
['movieId,title,genres', '1,Toy Story (1995),Adventure|Animation|Children|Comedy|Fantasy', '2,Jumanji (1995),Adventure|Children|Fantasy', '3,Grumpier Old Men (1995),Comedy|Romance', '4,Waiting to Exhale (1995),Comedy|Drama|Romance']

Answer the question

In order to leave comments, you need to log in

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question