News

GitHub3mon
When reading a XML file i am not getting all the rows and some columns show incorrect values.
df = spark.read.format('xml').options("rowTag", "lei:LEIRecord").load("20210223-gleif-concatenated-file-lei2.xml") It seems to work within acceptables run times. But when i validate the data in ...
GitHub3mon
unable to read xml file in spark standalone mode
I am using spark 2.1.0(scala 2.11.8) in windows stand-alone mode. I followed your instructions and started the spark shell using command %SPARK_HOME%/spark-shell ...