Senior Staff Engineer - (Linux,AWS,Terraform,Big Data)

Company Description

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.

Job Description

• 5+ years of experience with Linux, networking and security fundamentals.
• You should have experience with AWS cloud platform and infrastructure.
• 5+ years of experience working with infrastructure as code with Terraform or Ansible tools.
• Experience managing large BigData clusters in production (at least one of -- Cloudera, Hortonworks, EMR).
• Excellent knowledge and solid work experience providing observability for BigData platforms using tools like Prometheus, InfluxDB, Dynatrace, Grafana, Splunk etc.
• Expert knowledge on Hadoop Distributed File System (HDFS) and Hadoop YARN.
• Decent knowledge of various Hadoop file formats like ORC, Parquet, Avro etc.
• Experience with Hive (Tez), Hive LLAP, Presto and Spark compute engines.
• Understand query plans and optimize performance for complex SQL queries on Hive and Spark.
• Experience supporting Spark with Python (PySpark) and R (SparklyR, SparkR) languages
• Solid professional coding experience with at least one scripting language - Shell, Python etc.
• Experience working with Data Analysts, Data Scientists and at least one of these related analytical applications like SAS, R-Studio, JupyterHub, H2O etc.
• Read and understand code (Java, Python, R, Scala), but expertise in at least one scripting languages like Python or Shell.
• You will be reporting to a Senior Manager or a Director

Preferred skills:

• Experience in building, deploying, and monitoring distributed apps using container systems (Docker) and container orchestration (Kubernetes, EKS)
• Experience with workflow management tools like Airflow, Oozie etc.
• Knowledge in analytical libraries like Pandas, Numpy, Scipy, PyTorch etc.
• Implementation history of Packer, Chef, Jenkins or any other similar tooling.
• Prior work knowledge of Active Directory and Windows OS based VDI platforms like Citrix, AWS Workspaces etc.

Qualifications

Qualifications

• Bachelor of Engineering or Equivalent to bachelor's degree

Additional Information

Our uniqueness is that we truly celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what truly matters; DEI, work/life balance, development, authenticity, engagement, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's strong people first approach is award winning; Great Place To Work™ in 24 countries, FORTUNE Best Companies to work and Glassdoor Best Places to Work (globally 4.4 Stars) to name a few. Check out Experian Life on social or our Careers Site to understand why.

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is a critical part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, color, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Experian Careers - Creating a better tomorrow together

Benefits

Experian care for employee's work life balance, health, safety and wellbeing. In support of this endeavor, we offer best-in-class family well-being benefits, enhanced medical benefits and paid time off.

#LI-Onsite

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here