Data Engineer
CareCone Group · Sydney, Australia ·
- Employment
- Full time
- Category
- Data engineering
CareCone Group · Sydney, Australia ·
State Street · Bangalore, Karnātaka
State Street · Toronto, Ontario
Texplorers Inc · Hyderabad, India
d5ca7713-e342-4b90-89f2-0d351ff60dbb:19000101_000001 · at headquarters, Tualatin, OR, US
Designs, builds, and optimizes high-throughput data pipelines on Azure Databricks using Spark (Scala), SQL, and Python, following medallion architecture and Delta Lake best practices. Includes real-time streaming with Kafka/Spark Streaming and CI/CD via Git/Azure DevOps. Permanent, on-site role in Sydney.
Location : Sydney
Mode:Permanent
Job Description:
Primary or Mandatory skills
2. Scala Spark
3. SQL
4. Python
Good to have skills
Databricks, SQL, Python, Data warehousing concepts
Detailed Job description (Role & Responsibility, Skill and Experience range)
Expertise in cloud platforms and related technologies, specifically:
Data Platforms (e.g. Databricks) and big data technologies.
Real time data processing frameworks Spark Streaming, Apache/Confluent Kafka
Salt · Belgium