Job Description

5.00 to 15.00 Years
SYDNEY [Australia]
¿             Over 12 years of IT experience is required.¿             Must have Atleast 5 years of experience with Cloudera v 5.12.¿             Must have experience with solutions, design and development with cloudera.¿             Must have experience with Informatica Big Data Manager.¿             Experience in HDFS, MapReduce, Yarn, Hive, Pig scripts, Sqoop jobs, Oozie jobs to schedule Hadoop jobs, NoSQL database, MapReduce is required.¿             Experience in Spark Yarn and knowledge of Linux shell scripting.¿             Processing unstructured, semi structured and structured data.¿             Working on real time data ingestion using Spark streaming.¿             Writing Scala/Python codes on top on Spark.