Saicon is hiring a Senior Python/PySpark Data Engineer in India to build scalable data solutions: developing reusable Python packages and frameworks, writing unit/integration tests, running CI/CD via GitHub Actions, and tuning PySpark workloads (partitioning, JDBC, large-scale ingestion) with secure data access practices.
We are seeking a Senior Python / PySpark Data Engineer with strong software engineering fundamentals and hands-on experience building scalable data solutions.
Required Skills
Strong Python development experience with OOP, reusable code, classes, and functions
Experience building and deploying Python packages (PyPI, wheel files)
Expertise in Unit Testing and Integration Testing
Strong CI/CD experience using GitHub Actions
Solid PySpark knowledge, including:
Performance tuning and optimization
Partitioning and data ordering
JDBC tuning and large-scale data ingestion
Understanding of security best practices, access controls, and secure data access
Nice to Have
Experience with enterprise data platforms
Cloud and modern data engineering experience
What You'll Do
Develop scalable Python and PySpark applications
Build reusable frameworks and libraries
Implement automated testing and CI/CD pipelines
Optimize large-scale data processing workloads
Collaborate with engineering teams to deliver secure, high-quality solutions