Company Description
Serasa Experian is Brazil's first and largest Datatech company. A leader in intelligence solutions for risk analysis and opportunity identification, with a focus on credit journeys, authentication, and fraud prevention. With cutting-edge technology, innovation, and top talent, we transform risk uncertainty into the best decisions, helping people achieve their dreams and companies of all sizes and segments to thrive.
We have 22,000 people operating in 32 countries, and every day we are investing in new technologies, talented professionals, and innovation to help all our clients maximize every opportunity. With corporate headquarters in Dublin, Ireland, Experian is listed on the London Stock Exchange (EXPN) and is part of the FTSE 100 index.
Job Description
We are looking for a Senior Data Analyst to work on building, operating, and evolving data pipelines in an AWS environment.
This position will play a key role not only in technical delivery, but also in the evolution of the team's operational model, supporting and driving initiatives to automate the entire data processing journey through to delivery, increasing efficiency, scalability, and quality.
In addition, you will be responsible for working closely with clients and internal teams in understanding business rules, supporting homologation, validation, and documentation processes for solutions, ensuring technical compliance, and will also support the development of solutions with PySpark and Python, orchestrate workflows with Airflow, and act as the focal point for developed tools, with a focus on performance improvement, reliability, and continuous evolution.
Our team has high visibility within the company, being recognized for the ability to meet customized demands with excellence and a focus on the best customer delivery experience.
You will also support customized demands from internal and external clients through Jupyter Notebooks and technical analyses in a dynamic environment focused on the end customer experience.
Responsibilities
-
Develop data pipelines with PySpark
-
Create and maintain DAGs in Apache Airflow
-
Implement solutions in AWS (S3, EMR, EMR Studio)
-
Create notebooks for analyses and customizations
-
Act as the technical owner of solutions in production
-
Optimize performance and ensure data quality
-
Document and organize deliverables
-
Drive and support initiatives for automation of the end-to-end data journey
-
Work on understanding business rules with clients and stakeholders
-
Support homologation and validation processes for developed solutions
Team Differentials
- High level of internal exposure and impact on clients
- Work on customized and strategic projects
- Strong culture of continuous evolution and automation
- Direct interface with business and technology
Qualifications
Requirements
- Solid experience with Python and PySpark
- Experience with Apache Airflow
- Knowledge of AWS (S3, EMR, EMR Studio)
- Experience with Jupyter Notebook
- Knowledge of distributed processing and Data Lake
- Version control with Git
- Ability to work autonomously and with analytical vision
Differentials
- Experience with Iceberg
- Conversion of SQL (T-SQL) to PySpark
- Experience in migration to Cloud (AWS)
- CI/CD for data pipelines
- Knowledge of data governance and modeling
Artificial Intelligence Applied to Data
- Use of ML/AI for data analysis and insight generation
- Experience with libraries such as Scikit-learn, PyTorch, or TensorFlow
- Application of anomaly detection and segmentation
- Use of LLMs for data analysis and exploration
Additional Information
Experian is a global data and technology company that drives opportunities for people and businesses around the world. We operate in diverse markets, such as financial services, healthcare, automotive, agribusiness, insurance, among others. Experian invests in people and new advanced technologies to unlock the power of data. We have an incredible team of 25,200 employees in 32 countries.
Our uniqueness is valuing yours. Experian's culture, centered on people, inclusive and purpose-driven, is recognized by various awards — including World's Best Workplaces™ 2025 (Top 25 global by Fortune) and Great Place To Work™ in 26 countries, among others. Check out Experian Life on social media or explore our careers website to understand why. Experian is also proud to be an employer that promotes equal opportunity and affirmative action.
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here