Data Engineer IV- 4P/619
Tasks
- Build Lakehouse solutions using Databricks
- Create and support Power BI reporting
- Design and maintain batch data pipelines
- Design and maintain streaming data pipelines
- Develop and optimize ETL processes
- Develop and support Spark based platforms
- Implement CI/CD for data pipelines
- Manage data orchestration workflows
- Normalize and model data using dimensional modeling
- Transform raw data into curated datasets
- Use AI tools for SQL development and testing
- Use Git based version control for pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Spark | CI/CD | Data Lakehouse | Data Modeling | Databricks | Dimensional Modeling | ETL | Git | NoSQL | Power BI | SQL | SQL Server | SSIS | Star Schema
Education
N/A
Roles
Related jobs
-
Senior Data Engineer USD 175K-215KAngular | Dashboards | Data Visualization | Microservices | NoSQLSenior-level Full TimeWashington, DC, United States1h ago
-
Mid-level Full TimeAnnapolis Junction, MD3h ago
-
Mid-level Full TimeAnnapolis Junction, MD3h ago
-
Mid-level Full TimeAnnapolis Junction, MD3h ago
-
Data Engineer - Supply Chain USD 120K-164KApache Spark | CI/CD | Data Governance | Data Lineage | Data ModelingSenior-level Full TimeAuburn Hills, MI, United States4h ago
-
Senior Data Engineer USD 131K-220KApache Spark | Data Migration | Data Visualization | Data Warehouse | Database DesignBest place to work recognition | Employee development | Fastest Growing company recognition | High employee moraleSenior-level Full TimeHuntsville, United States5h ago
-
Mid-level Full TimeSan Diego, California, United States6h ago
-
Data Engineer USD 62K-62KAzure Data | Azure Data Factory | DBT | Data Factory | Data Modeling401k matching | Dental insurance | Disability insurance | Flexible spending account | Internal promotion opportunitiesEntry-level Full TimeKS, Leawood6h ago
-
Click Through Rate | Click Through Rate Prediction | Cold Start | Conversion Rate | Conversion Rate PredictionSenior-level Full TimeSeattle, Washington, United States6h ago
-
Software Engineer, BigQuery Metadata USD 147K-211KBigQuery | C++ | Cloud platform | Data Storage | Database systemsMid-level Full TimeSunnyvale, CA, USA7h ago
-
Data Engineers - Senior #IN1265 USD 108K-133KAccess Control | Agile | Cloud Platforms | Data Governance | Data IntegritySenior-level Full TimeColumbus, IN, United States9h ago
-
Data Engineer Principals #IN1214 USD 127K-155KAgile | Apache HBase | Apache Hive | Apache Kafka | Apache SparkSenior-level Full TimeColumbus, IN, United States9h ago
-
Staff Data Engineer USD 114K-171KCloud Platforms | Data Modeling | Data Pipelines | Data Warehousing | Data integrationDental insurance | Health care | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeResidence Based, Residence Based, US10h ago
-
Staff Partner Engineer, Azure USD 150K-206KAI Platform | AI Platform Integration | API Integration | Apache Spark | Architecture DiagramsAnnual performance bonus | EquitySenior-level Full TimeNew York City, New York; San …15h ago
-
Applied AI ML lead USD 167K-205KAdaBoost | Anomaly Detection | Autoencoders | Classification | Data QualityBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeMc Lean, VA, United States16h ago
-
Fabric - Sr Data Engineer USD 112K-185KAPI-based integration | Access Control | Active Directory | Azure | Azure Active DirectorySenior-level Full TimeUnited States16h ago
-
Agile | Algorithms | CI/CD | Data Engineering | Data Structures401k plan | Accident insurance | Dependent care FSA plan | HSA and FSA | Hospital indemnity insuranceSenior-level Full TimeAustin, Texas or Remote R16h ago
-
Pre-Sales Data Scientist USD 70K-90KAPIs | AUC | Credibility Testing | Cross-validation | Data AnalysisCompany sponsored volunteering days | Discounted private health insurance | Extra paid time off | Fully remote within continental United States | Generous parental leaveMid-level Full TimeCarlsbad, CA, United States R16h ago
-
Applied Scientist, Amazon Prime, Prime AI/ML Science USD 136K-184KAmazon DynamoDB | Amazon EMR | Amazon Redshift | Amazon S3 | Amazon SageMakerSenior-level Full TimeSeattle, Washington, USA19h ago
-
GCP Data Engineer USD 68K-168KBigQuery | CI/CD | Cloud Storage | Cloud platform | ComposerCompany-Paid Holidays | Employee assistance program | Hybrid work | Life and disability insurance | Medical, dental, and vision coverageMid-level Full TimeNashville, TN, US19h ago
-
GCP Data Engineer USD 53K-122KAirflow | Apache Beam | BigQuery | CI/CD | Cloud StorageCompany-Paid Holidays | Employee assistance program | Life and disability insurance | Medical, dental, and vision coverage | Paid time offMid-level Full TimeNashville, TN, US19h ago
-
GCP Associate Data Engineer USD 43K-105KAI machine learning | Airflow | Apache Beam | BigQuery | CI/CD401k retirement savings | Company holidays | Disability insurance | Employee assistance program | Life insuranceMid-level Full TimeBridgewater, NJ, US19h ago
-
Data Engineer - Production Support USD 74K-99KADLS | Azure | Azure Data | Azure Data Factory | Azure Databricks401k match | Employee assistance program | Employee stock purchase plan | Health and wellness allowance | Hybrid work environmentMid-level Full TimeIrving - 6011 Connection, United States19h ago
-
Data Engineer, Integrations USD 140K-177KAWS | Airflow | Azure | Boomi | CCPA401k match | Dental insurance | Life insurance | Medical insurance | Tuition reimbursementMid-level Full TimeWaltham Office, United States19h ago
-
Senior Data Engineer USD 162K-242KCloud Platforms | Data Lakes | Data Modeling | Data Pipelines | Data Transformation401k match | Company holidays | Dental insurance | Life insurance | Long-term disabilitySenior-level Full TimeUSA - MA - Cambridge, United … R19h ago