Skip to content

About

Spark Version.- 2.4.5

Resources

Stars

1 star

Watchers

1 watching

Forks

Latest commit

 

History

5 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

export output=/mapreduce/wordcount/output
echo " ### hadoop folder delete #### ===>  $output"
hadoop fs -rmr $output
spark-submit --master yarn --class org.jacob.SparkWordCount ./target/spark_wordcount-1.0-SNAPSHOT.jar \
                                               /mapreduce/wordcount/input $output \

echo " check the number of lines on $output "
hadoop fs -cat $output/* | wc -l

About

Spark Version.- 2.4.5

Resources

Stars

1 star

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages