Senior Data Engineer
IN-INDIANAPOLIS, 220 VIRGINIA AVE, United States
USD 127K-228K Senior-level Full Time
Tasks
- Coordinate reporting of data security events and incidents
- Define semantic and consumption layers
- Design end to end data ingestion storage transformation and enrichment
- Develop test plans for deployment validation and data quality checks
- Ensure data pipelines meet security and regulatory requirements
- Lead incident recovery and root cause analysis
- Lead platform engineering standards and roadmap
- Lead security data lake architecture
- Manage Microsoft Fabric workspaces and pipeline configurations
- Perform capacity analysis and recommend platform scaling
- Provide technical escalation for preventative maintenance outcomes
- Represent upgrades in change control across dev test and production
- Supervise preventative maintenance
- Support business risk assessments with information security procedures
- Troubleshoot complex data pipeline and integration issues
Perks/Benefits
- 401k match
- Dental insurance
- Equity stock purchase
- Financial education resources
- Hybrid work
- Incentive and recognition programs
- Life insurance
- Long-term disability
- Medical insurance
- Paid Holidays
- Paid time off
- Short-term disability
- Vision insurance
- Wellness programs
Skills/Tech-stack
Apache Spark | Azure DevOps | CI/CD | Cause analysis | Data Governance | Data Quality | Data pipeline | Delta Lake | Git | JSON | Microsoft Fabric | Parquet | PySpark | Python | REST API | Root Cause Analysis | Root cause | SQL
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
AWS | Agile | Confluence | Django | Docker401k match | Career development | Dental insurance | Health insurance | HolidaysSenior-level Full TimeLinthicum Heights, MD; Linthicum Heights, MD; …1h ago
-
Agile | Ansible | Apache NiFi | Automation | Continuous Monitoring401k employer contribution | Career development and training | Holiday pay | Paid health dental and vision premiums | Paid time offSenior-level Full TimeLinthicum Heights, MD; Laurel, MD; Laurel, …1h ago
-
AWS | Agile | Confluence | Data Gathering | Django401k employer contribution | Career counseling | Education and training support | Employee referral bonuses | Flexible work-life balanceMid-level Full TimeLinthicum Heights, MD; Linthicum Heights, MD; …1h ago
-
Natural Language Processing (NLP) Specialist USD 100K-115KData Visualization | Deep learning | Information Retrieval | Language Processing | Machine LearningBirthday day off | Comprehensive health coverage | Flexible work schedule | HSA/FSA | Life insuranceMid-level Full TimeAnnapolis Junction, MD; Annapolis Junction, MD; …1h ago
-
ActiveMQ | Agile | Amazon Web Services | Apache Beam | Apache CassandraMid-level Full TimeSan Mateo, CA; Irving, TX; Sunnyvale, …2h ago
-
Senior-level Full TimeSan Bruno, CA; San Bruo, CA; …2h ago
-
API | Amazon Web Services | Amazon Web Services (AWS) | Apache HDFS | Apache SparkRemote workMid-level Full TimeRemote, US; Sunnyvale, CA; Dallas, TX R2h ago
-
Adobe Analytics | Airflow | Apache Hive | Apache Spark | Data LineageSenior-level Full TimeSan Bruo, CA; San Bruno, CA; …2h ago
-
Airflow | C++ | Data Pipelines | Distributed Computing | ElasticsearchSenior-level Full TimeSunnyvale, CA; Palo Alto, CA; St. … R2h ago
-
Mid-level Full TimeAtlanta, GA; San Bruno, CA; Dallas …2h ago
-
Mid-level Full TimeSunnyvale, CA; San Bruno, CA; Dallas …2h ago
-
Mid-level Full TimeSunnyvale, CA; San Bruno, CA; Dallas …2h ago
-
Entry-level Full TimeBangalore, India; Sunnyvale, CA; San Bruno, …2h ago
-
Mid-level Full TimeSunnyvale, Ca; San Bruno, CA; Dallas …2h ago
-
Apache Drill | Apache HBase | Apache Hadoop | Apache Hive | Apache SparkMid-level Full TimeSunnyvale, Ca; San Bruno, CA; Dallas …2h ago
-
Apache Spark | Avro | Azure Data | Azure Data Factory | Azure Data LakeRemote work optionMid-level Full TimeDallas / Philadelphia, USA; Bangalore, India; …2h ago
-
AWS | Amazon S3 | Angular | Anomaly Detection | Apache AirflowMid-level Full TimeIrving, TX; Sunnyvale, CA; Sunnyvale, CA; …2h ago
-
Apache Airflow | Apache Drill | Apache Hive | Apache Spark | ElasticsearchMid-level Full TimeCarlsbad, CA; San Bruno, CA; Dallas …2h ago
-
Mid-level Full TimeSan Bruno, CA; Sunnyvale, CA; Sunnyvale, …2h ago
-
Mid-level Full TimeSunnyvale, CA; San Bruno, CA; Dallas …2h ago
-
Mid-level Full TimeSunnyvale, CA; San Bruno, CA; Dallas …2h ago
-
Apache Hadoop | Apache Hive | Apache Pig | Apache Spark | Business ObjectsMid-level Full TimeDallas, TX; San Bruno, CA; Dallas …2h ago
-
Apache Kafka | Apache NiFi | Apache Spark | Big Data | Big Data PipelinesMid-level Full TimeSunnyvale, CA; Sunnyvale, CA; Bentonville, AR; …2h ago
-
Mid-level Full TimeSan Bruno, CA; San Bruno, CA; …2h ago