Collecting the data

"I completed my bachelor's degree in computer science in India, followed by an internship in France. I then pursued a master’s degree through the Erasmus Mundus program in Software Engineering for the Green Deal — a multidisciplinary, three-country program focused on sustainability and software. I completed my thesis at VU Amsterdam, and throughout this journey, I’ve developed a strong passion for combining sustainability with innovative software solutions."

"I came across Northpool at the Beta Career Event in Amsterdam, which was recommended to me by my university. As part of the event, I submitted my application for a speed date, and was matched with Northpool for a one-on-one session. The session began with a mutual exchange of information about myself and the company. We conducted a review of my CV, followed by questions based on my experiences. I asked several questions about the company out of curiosity and interest. The HR Manager then introduced the available positions, explained the application process at Northpool, and outlined the selection criteria. The conversation concluded with questions regarding my motivation and current academic situation. After submitting my application, I was invited to the Leiden office, where I received an office tour and had a first interview. It provided me with more in-depth information about the company and the role of Data Engineer at Northpool. We discussed my background and motivation, followed by a Q&A session focused on energy trading, data sources, and the daily responsibilities of a Data Engineer.

The second interview was a technical interview. I was asked technical questions related to SQL and web scraping in Python. My interviewer provided a detailed explanation of the data engineering work at Northpool. The interview also included questions regarding my strengths and weaknesses, and we concluded by discussing the questions I had about the role."

"My first impression was one of curiosity and confusion — I couldn’t quite grasp the concept of energy trading and found myself asking, 'What do you mean you trade energy?' When I first visited the office, I was struck by the sheer number of screens and the constant buzz of activity. What stood out to me, though, was how deeply integrated technology is in the trading process, which I found both exciting and impressive."

"Working at Northpool is like navigating controlled chaos. While day-to-day operations may be routine, there’s always the element of unexpected challenges that require quick problem-solving. At Northpool, we place a strong emphasis on data-driven decision-making, particularly for trading, making it crucial to convert business requirements into tangible products while incorporating valuable feedback from stakeholders. The flat hierarchical structure here makes it easy to approach stakeholders and get timely input. Additionally, I appreciate the flexibility of working on various projects across different trading departments and the opportunity to explore diverse technologies and data pipelines, including both batch and stream data processing."

"As they say in Data Science 101, 'Garbage in, garbage out.' The quality of data is crucial to everything we do. From algorithmic trading to weather models, each process depends on the timely and accurate input of data. In a fast-moving market, being the first to access reliable, factual data can provide a significant edge, allowing us to stay ahead of the competition."

"Data, at its core, is about facts. In trading, it’s essential to make decisions based on solid data rather than opinions. Personally, I find data fascinating because it uncovers trends and patterns across diverse fields such as economics, meteorology, trading, and sustainability. It strengthens decision-making and helps mitigate risk. What makes working with data exciting is the constant challenge it presents — no two data sources or datasets are the same. Whether it's structured or unstructured, batch or stream, images, or high-dimensional data, each type is like a unique puzzle piece that, when mastered, helps you succeed in the game."

"At Northpool, I work with multiple Scrum teams. My day typically starts with checking emails, reviewing Jira tickets, and monitoring any faults. I then attend the daily standup meetings to discuss project progress and see how I can further support the team. After that, my focus shifts to building and maintaining data pipelines, which can range from complex SQL pipelines to gathering data using Python scrapers, depending on the project. Throughout the day, I also collaborate with other data engineers to monitor system performance and address any issues. In addition, I handle ad-hoc data requests from traders and other departments working on their respective projects."

"I aim to grow in a role that balances both business and technical knowledge. I want to become more valuable to the trading desks by understanding their needs deeply and supporting them effectively. I’m also looking to greater ownership of data pipelines within the company and work with a wide range of data technologies."

"I like the approachable and supportive colleagues, the constant stream of interesting projects, and the immediate visibility of the impact my work has. The short feedback loop, strong focus on product value, and the flexibility to work across different teams and projects make it a dynamic and rewarding environment."