Skip to content Skip to sidebar Skip to footer
Showing posts with the label Hdfs
Pyspark: How To Covert Column With Ljava.lang.object

Pyspark: How To Covert Column With Ljava.lang.object

Post a Comment
I created data frame in PySpark by reading data from HDFS like this: df = spark.read.parquet('p… Read more Pyspark: How To Covert Column With Ljava.lang.object
Get A List Of Subdirectories

Get A List Of Subdirectories

Post a Comment
I know I can do this: data = sc.textFile('/hadoop_foo/a') data.count() 240 data = sc.textFi… Read more Get A List Of Subdirectories
I Want To Call Hdfs Rest Api To Upload A File

I Want To Call Hdfs Rest Api To Upload A File

Post a Comment
I want to call HDFS REST api to upload a file using httplib. My program created the file, but no co… Read more I Want To Call Hdfs Rest Api To Upload A File
Is It Possible To Save Files In Hadoop Without Saving Them In Local File System?

Is It Possible To Save Files In Hadoop Without Saving Them In Local File System?

Post a Comment
Is it possible to save files in Hadoop without saving them in local file system? I would like to do… Read more Is It Possible To Save Files In Hadoop Without Saving Them In Local File System?