• 1Search for courses by Study Area, Level and Location
  • 2We deliver you all the matched results
  • 3Choose one or more course providers to contact you
Industry

Distance from location (kms)

Exact 5 10 25 50 100

Posted since

All 2 Days 1 Week 2 Weeks 1 Month

Sort results by

Relevance Date

30

April

Data Engineer

Private Company - North Sydney, NSW

Any Industry
Source: uWorkin

Source: uWorkin

JOB DESCRIPTION

Manvision Consulting provides IT Contracting and Professional Services to the Australian Market since 2008. Join a talented team and work in a culture that stimulates an inclusive and flexible work environment, offering opportunities to grow and contribute to the company.

Roles and Responsibilities

  • 4 - 8 years experience required
  • Good hands-on experience with on-premise Hadoop clusters involving data ingestion from various sources to HDFS, Hive, etc.
  • Use of Spark, Python, PySpark, HiveQL is desired.
  • Strong understanding of Azure environment (PaaS, IaaS) and experience in working with the Hybrid model.
  • Expertise in setting up and running MS HDInsight.
  • Good experience in MS Bigdata project experience in Azure HDInsight Stack that involves components like HDInsight/Hortonworks (Pig, Hive, YARN, HBase)
  • Azure Blob Knowledge in Azure Power Shell scripting for deploying the Resources like Azure Storage, Hindsight cluster, Azure Data factory.
  • Expose data to end-users using Power BI, Azure API Apps or other modern visualization platform or experience.

Skills Required

  • BigData
  • Hadoop Ecosystems
  • HDFS
  • Hive
  • Spark
  • Python
  • PySpark
  • HiveQL
  • PaaS
  • IaaS
  • MS HDInsight
  • MS Bigdata
  • Azure HDInsight
  • Hortonworks
  • Azure Blob
  • Azure Storage
  • Hindsight cluster
  • Azure Data factory
  • Power BI
  • Azure API Apps