Data Engineer 1
Beusa Energy, LLC · Beusa The Woodlands Corporate Office Six Pines - The Woodlands, TX 77380 ·
- Category
- Data engineering
Build and optimize Databricks Lakehouse pipelines (Delta Lake, DLT) and SQL Warehouses to deliver fast, reliable energy data at low cost, plus Power BI dashboards and data models.
Data Engineer
Job Description
Department: Data Technology
Job Status: Full-Time
FLSA Status: Salary-Exempt
Reports To: Data Engineering Supervisor
Location: The Woodlands, TX
Amount of Travel Required: 5-10%
Work Schedule: Monday-Friday, 8 a.m.-5 p.m.
Positions Supervised: None
AIP Level: 7
POSITION SUMMARY: As a Data Engineer at Beusa, you will own the performance, reliability, and cost-efficiency of our Databricks environment. You'll design and optimize Delta tables, pipelines, and SQL Warehouse workloads so teams get fast, trustworthy data at the lowest reasonable cost. You will collaborate with cross-functional teams to translate requirements into high-performing, production-grade datasets and dashboards with clear SLAs.
ESSENTIAL FUNCTIONS: (The following duties and responsibilities are all essential job functions, as defined by the ADA, except for those that begin with the word "may.")
- Build and operate Lakehouse pipelines on Databricks (Bronze/Silver/Gold) using Delta Lake, Delta Live Tables (DLT), and/or Jobs.
- Own ingestion patterns (Autoloader, CDC, streaming) optimization
- Own data modeling, quality checks, and performance optimization.
- Own performance optimization - profile and tune Spark/SQL workloads: partitioning, clustering, constraints, liquid clustering (if applicable), manage table health.
- Engineer Delta tables for speed and cost: partitioning, Z-Ordering or clustering, constraints, file sizing; manage table health with Auto Optimize, OPTIMIZE, and VACUUM.
- Implement incremental processing patterns (MERGE with Change Data Feed, APPLY CHANGES INTO) with idempotency and exactly-once delivery.
- Partner with data consumers to deliver reliable, well-documented datasets with clear SLAs.
- Design, build, and implement interactive dashboards and reports using Power BI and other visualization tools.
- Collaborate with business units (Operations, Field Engineers, Assets) to gather requirements and translate them into technical solutions.
- Develop and maintain data models, ensuring data quality and integrity.
- Integrate data from multiple sources, including real-time field equipment and sensors.
- Continuously evaluate and adopt new data management and analytics technologies.
- Educate and support stakeholders on data tools and best practices.
- Advocate for Beusa's digital transformation and data-driven decision-making.
- Engage with technology vendors and partners as needed.
- Occasional travel to meet with stakeholders.
- Perform other related duties as assigned to assist with successful operations and business continuity.