Senior Data Engineer
Tasks
- Build Lakehouse solutions with Medallion architecture
- Collaborate to define and deliver data products
- Configure monitoring alerting and observability
- Design and document data models
- Design data integration solutions
- Develop Power BI and SSRS reports
- Develop scalable data pipelines
- Ensure data security, privacy, and compliance
- Evaluate data quality and observability tools
- Implement CI/CD pipelines
- Implement configuration driven ingestion
- Implement data governance cataloging and MDM
- Improve data engineering processes for efficiency and automation
- Ingest transform and integrate diverse data sources
- Manage access controls data lineage and metadata
- Mentor junior engineers and provide technical guidance
- Optimize data pipelines for performance, scalability, and cost
- Oversee Azure data platform health scalability security
- Participate in Scrum ceremonies and Agile planning
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | Agile | Alerting | Azure | Azure Data | Azure Data Factory | Backlog Refinement | CI/CD | CSV | CircleCI | Data Catalog | Data Factory | Data Flow | Data Flow Diagrams | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Data dictionaries | Databricks | Dimensional Modeling | ERD | ETL | Flow diagrams | GitHub | GitHub Actions | GitHub Actions CI/CD | GitHub Actions workflows | JSON | Lakehouse | MDM | Medallion Architecture | Metadata Management | Monitoring | NoSQL | Observability | Power BI | SQL | SQL Server | SSRS | Scrum | Sprint Planning | T-SQL | XLS | XML
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R16d ago
-
Lead BI Engineer USD 110K-135KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeWestchester, IL, United States7h ago
-
Senior-level Full TimeCincinnati, OH, United States8h ago
-
Software Engineer 2 USD 129K-223KAPI Gateway | AWS | AWS CodePipeline | AWS Lambda | AWS Step FunctionsMid-level Full TimeAnnapolis Junction, MD8h ago
-
AWS | Agentic AI | Azure | CI/CD | Cloud platformLocal candidate preference | Onsite workMid-level ContractDallas, United States10h ago
-
AWS | Agentic AI | Automated testing | Azure | CI/CD100 percent onsite | 5 days per week | HackerRank assessment required | Local candidates onlyMid-level ContractCary, United States10h ago
-
Senior Graph AI Engineer USD 141K-202KAPI deployment | Cloud Architecture | Context orchestration | Cypher | Data ModelingSenior-level Full TimeNorth Chicago, United States10h ago
-
Mid-level Full TimeArlington/Rosslyn, Virginia, United States; Cleveland, Ohio, …11h ago
-
Data Engineer USD 192K-196KBig Data | Data Architecture | Data Visualization | Data Warehouse | Database systemsEntry-level Full TimeMenlo Park, CA12h ago
-
Data Engineer USD 209K-235KData Governance | Data Modeling | Data Quality | Data Security | Data VisualizationTelecommuting allowedSenior-level Full TimeMenlo Park, CA | Remote, US R12h ago
-
Data Engineer, Analytics USD 209K-235KBig Data | Data Governance | Data Modeling | Data Quality | Data VisualizationSenior-level Full TimeMenlo Park, CA12h ago
-
Data Engineer, Analytics USD 185K-196KBig Data | Data Governance | Data Quality | Data Security | Data WarehousingMid-level Full TimeMenlo Park, CA12h ago
-
Senior-level Full TimeNew York, NY12h ago
-
Accessibility | Artificial Intelligence | Data Analysis | Data Mining | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA13h ago
-
AI Middleware Engineer USD 99K-195KAI Agent | AI Agent Frameworks | API Design | API Security | Agent FrameworksClient-facing work | Production impactMid-level Full TimeSan Francisco19h ago
-
Software Engineer, Applied AI USD 130K-500KData Pipelines | Data Quality | Evaluation | Experimental Design | GoEquity 4 year vest | Free gym membership | Health insurance | Housing bonus | Meal stipendMid-level Full TimeSan Francisco21h ago
-
Senior Data Engineer USD 136K-160KApache Spark | Azure Data | Azure Data Factory | Azure Event | Azure Event Hubs401k match | Employee assistance program | Free parking | Healthcare | Hybrid workplace flexibilitySenior-level Full TimeCharlotte, North Carolina, United States; Virtual R22h ago
-
Optimization Software Engineer USD 132K-198KAPIs | AWS | Algorithms | Amazon CodeWhisperer) | Azure401k matching | Commuter benefits | Healthcare benefits | Life and disability insurance | Mental health resourcesMid-level Full TimeWashington, District of Columbia, United States22h ago
-
Quantum Software Engineer USD 132K-198KC# | C++ | CI/CD | CUDACUDAQ | CUDALabCaregiver leave | Commuter benefits | Disability insurance | Family planning support | Life insuranceMid-level Full TimeWashington, District of Columbia, United States22h ago
-
Principal Software Engineer - Oracle HDI Analytics Platform Infrastructure Engineering & Reliability USD 96K-223KAWS | CI/CD | Cloud Compliance | Data Warehousing | DockerSenior-level Full TimeUnited States23h ago
-
Mid-level Full TimeDes Moines, Iowa1d ago
-
Mid-level Full TimeRemote, XX, United States R1d ago
-
Senior-level Full TimeNew York, NY, United States1d ago
-
Data Engineer USD 124K-149KAutomation | Cloud Computing | Cloud Storage | Data Analysis | Data Modeling401k match | Dental insurance | Health insurance | Health savings account | Life insuranceSenior-level Full TimeUSA DC Washington - 330 C …1d ago
-
Database Administrator / Data Engineer USD 80K-95KAWS Glue | AWS Lake Formation | AWS S3 | Access Control | Always OnCareer growth opportunities | On-call rotation | Use of AI assisted development toolsMid-level Full TimeSan Antonio, TX (North Loop 1604), …1d ago