Research & Projects
In addition to students there is a vast network of TU Delft researchers active in various energy efficiency projects. Many of these researchers are in the steering board of this platform on smart energy efficiency or have ties to members of the platform. Many of these projects cross the borders of the TU Delft campus and even the borders of the Netherlands. Many projects are namely being executed as European initiatives in resourceful consortia in different countries. Below is an overview of some of these projects in which the TU Delft and platform members are involved.
CELSIUS, a major European low carbon energy program under the Smart Cities and Communities umbrella of the European Research Program (FP7). The overall aim with the project is to save energy by using more wasted excess heat in Europe. The potential is huge; there is actually enough waste heat unused in Europe to heat the entire European building stock. In Gothenburg the district heating provides heat to more than 90 % of all apartment buildings. The average figure for the EU is 10 %. The barriers are not of technical nature but policies, investments, attitudes and business models. CELSIUS has a clear strategy and a pro-active approach to deployment, which will result in 50 new cities committing to the CELSIUS roadmap by the end of 2016. The core in the project is the demonstrators, these are in the field of System Integration, Sustainable Production, Storage and DC, Infrastructure and the End user.
The partner cities are London, Rotterdam, Genoa, Cologne and Gothenburg. The consortium has 21 partners which cover all parts of the value chain to assure collaboration with all actors such as cities, utilities, industry, politicians, financiers, universities and research centers from the different cities. Among others the partners are Delft University of Technology London School of Economics, Imperial College and SP Research Institute from Sweden.
A city operating entirely on clean energy. In theory, it's possible. But in real life? How to integrate new solutions in existing buildings, systems and people's lives? What are the technical, economic or social barriers? And how to overcome these? These questions are aimed to be answered through 20 projects in Grenoble and Amsterdam. These projects are in the field of building retrofit, heating and cooling, smart grids, monitoring, integrated issues and societal issues.
- INNOVATIES RIJSWIJK
Monitoring the Rijksvastgoedbedrijf testbed in Rijswijk, supported by Central Government Real Estate Agency – Rijksvastgoedbedrijf under the program Green Technologies 3.0, leaflet. The aim of the project is to stimulate and provide proof on the feasibility and viability of sustainable innovation. The building of Rijkswaterstaat is subject to these experiments in the field of: a) internet of things – create a smart building which reduces energy consumption and improves comfort, b) Climate – improve comfort and reduce energy consumption, c) Light – reduce the electricity consumption for lighting and improve the quality of lighting and d) Active façade - optimal utilization of energy available in the direct environment, the façade of the building can generate and store sustainable energy. This project is also conducted in partnership with the Green Village.
“Rapidly-deployable, self-tuning, self-reconfigurable nearly-optimal control design for large-scale nonlinear systems”
The inability of existing theoretical and practical tools to scaleably and efficiently deal with the control of complex, uncertain and time-changing large-scale systems, not only leads to a effort-, time- and cost-consuming deployment of Large-Scale Control Systems (LSCSs), but also prohibits the wide application of LSCS in areas and applications where LSCSs could potentially have a tremendous effect in improving system efficiency and Quality of Services (QoS), reducing energy consumption and emissions, and improving the day-to-day quality of life.Based on recent advances of its partners on convex design for LSCSs and robust and efficient LSCS self-tuning, the AGILE project aims at developing and evaluating an integrated LSCS-design methodology, applicable to large-scale systems of arbitrary scale, heterogeneity and complexity and capable of:- Providing proactive, arbitrarily-close-to-optimal LSCS performance;- Being intrinsically self-tuneable, able to rapidly and efficiently optimize LSCS performance when short- medium- and long-time variations affect the large-scale system;- Providing efficient, rapid and safe fault-recovery and LSCS re-configuration; and,- Achieving all the above, while being scalable and modular. To ease implementation and deployment of the AGILE system in existing open-architecture SCADA/DCS infrastructures, a set of open-source interfacing tools will be developed. The integrated LSCS design system to be developed within AGILE along with the interfaces will be extensively tested and evaluated into two real-life large-scale Test Cases (a 20-junction urban traffic network and a large-scale energy-controlled building) possessing a rich variety of design and performance characteristics, extremely complex nonlinear dynamics, highly stochastic effects, uncertainties and modeling errors, as well as reconfiguration and modular design requirements.
PLANHEAT will develop and validate an integrated and easy-to-use tool to support local authorities in selecting, simulating and comparing alternative low carbon and economically sustainable scenarios for heating and cooling. It will be validated in the three PLANHEAT cities. The PLANHEAT simulation tool will be designed to support local authorities in:
- mapping the potential of locally available low-carbon energy sources
- mapping the forecasted demand for heating and cooling
- defining and simulating alternative environmentally friendly scenarios
- understanding the interactions of these new scenarios with the existing infrastructures and networks
- identifying potential for further extension and upgrade of district heating and cooling networks
evaluating the benefits in terms of energetic, economic and environmental gains.
Today's Technical Systems of Systems (TSoS) such as transport, traffic and energy management systems require the deployment of an expensive-to-deploy and operate sensor and communication infrastructure. Moreover, they need a very time/effort-consuming modelling, analysis and control design procedure in order to achieve an efficient performance. On the contrary, Natural Systems of Systems (NSoS) such as the human brain, animal herds (swarms), teams of interacting/cooperating humans or animals achieve a highly efficient, elegant and supreme functionality without the need of an expensive infrastructure as they primarily rely on local information between neighbouring systems and, most importantly, they do not need any modelling, analysis or control design tools to achieve such a functionality. If the powerful attributes of NSoS were possible to be transferred and embedded into TSoS, this would lead not only to more efficient TSoS operations but, most importantly, to TSoS that are significantly easier, safer and more economical to design, deploy and operate. This is actually the main objective of Local4Global:to develop, test and evaluate a new ground-breaking, generic and fully-functional methodology/system for controlling TSoS which - as in the NSoS case - optimizes the TSoS performance at the global level without the need of deployment and operation of an expensive sensor and communication infrastructure and, most importantly, without the need for the use of elaborate and time/effort consuming modelling, analysis and control design tools. By embedding in TSoS attributes currently found only in NSoS, Local4Global's ambition is to develop a system that can be embedded in every day TSoS operations, produce substantial savings and Quality-of-Service improvements with the requirement of using the minimum possible infrastructure and minimum installation/operation effort. The economic and societal impact and consequences of the availability of such a system will be tremendous in literally any activity of everyday life: for instance, drivers/travellers will spent significantly less time for commuting, building occupants will see their energy bills significantly reduced and, most importantly, energy consumption and pollution will be substantially reduced. Furthermore, Local4Global application will not be only limited to areas and systems where no sophisticated control is currently employed (due to the requirement for an elaborate infrastructure). It will also be of great significance to areas and systems where, despite that the infrastructure is there, current control and management systems "cannot do the job". The Local4Global advances will lead to a fully-functional and ready-to-use system (Local4Global final product) - delivered in the form of an embedded, web-based, "plug-and-play" software system for generic TSoS. This system will be deployed and extensively tested in 2 real-life TSoS Use Cases, a Traffic TSoS Use Case and a Building TSoS Use Case.
MSc topic: Big data to improve our understanding of energy use of buildings
Buildings are responsible for about 40% of global energy use. It is surprising how little we know about what all this energy is used for. This is especially the case for buildings in the service sector (offices, schools, hospitals, etc.). We only have anecdotal information of how much of all the energy is used for various categories, like lighting, computers, heating, ventilation and air conditioning. We also do not know how efficient the energy is used.
At the same time, lots of data are gathered, e.g. from smart meters, ICT systems, wifi connectivity, and building management systems. The aim of the master thesis project is to investigate whether we can get a better understanding of energy use in buildings if we combine all these data in a smart way.
The idea is to use data for buildings at Delft University of Technology. Currently, this data is gathered. The research work will include energy analysis of the buildings combined with statistical analysis of the data.
Suitable master programmes are: Computer Science, Sustainable Energy Technology, Industrial Ecology, Complex Systems and Management.
For more information, please contact Kornelis Blok, email@example.com.
MSc topic: Agent-based modeling of consumer behavior (Afstudeer Atelier)
Please be invited to the master thesis project atelier on agent-based modeling of consumer behavior. This is set up in coordination to a H2020 project Cheetah, Changing Energy Efficiency Technology Adoption in Households. In this European project, a better understanding of household behavior is sought in order to find ways to increase the energy efficiency of energy appliances in households, it studies which policies work well in what contexts, and adopts a number of modelling approaches, amongst others agent-based modelling.
Assignments are framed in correspondence to the Cheetah project, but they are adapted according to the wishes and strengths of thesis candidates. The atelier runs continuously and there are up to four positions available per year. Please contact Emile Chappin if you're interested. Affinity with and a background in agent-based modeling is strongly recommended. All projects will be state-of-the art and in interactions with project partners. More on Cheetah can be found here.
Possible projects include:
- The analysis and comparison of models of the Theory of Planned Behavior on consumer behavior,
- New agent-based model analysis techniques applied to consumer technology adoption behavior,
- Understanding of intermediary parties and cooperatives and intermediary-specific policies,
- The importance of rebound effects through a second hand market for energy-intensive appliances,
- Realism of ABM studies on energy efficiency.
Specialisation - Electives package: Advanced Modelling Gaming and Design
Program: EPA; SEPAM/CoSEM
Methods: Agent-based modelling)
For more information, please contact Emile Chappin
MSc topic: HVAC diagnostics benchmark
Researchers in the area of hybrid systems are often looking for benchmarks where to test their methodologies. Heating, ventilating and air conditioning (HVAC) systems offer this opportunity, because thermostatic behaviour and faults give rise to interesting hybrid dynamics. This assignment starts from the experience of DCSC in modelling HVAC system. You are required to develop a simulator of a multiple-room HVAC system, that can be made freely available (e.g. on GitHub) to the scientific community.
Material provided: report and scientific papers on the topic, initial Matlab software
Expected output: Matlab model, user's guide for the software
Requirements: neat programmer, advanced Matlab programming skills
Department/Faculty: Delft Center for Systems & Control at 3mE
For more information, please contact Simone Baldi, S.Baldi@tudelft.nl
- Modelling and control of CyberPhysical and Human Systems in an office building
Name: Siva Subramanian Swaminathan
Heating, Ventilation and Air-Conditioning (HVAC) units in commercial buildings account for a huge portion of global energy consumption. There is an ever growing need to optimize the energy consumption of an HVAC system along with a system-of-subsystems entity that must be accurately integrated and controlled by the building automation system to ensure the occupants’ comfort with reduced energy consumption. To achieve these goals, it is necessary that accurate models be developed that describe the internal dynamics of the system to employ a satisfactory control architecture. This thesis work aims at provide sufficiently accurate models which are able to estimate the temperature, humidity and CO2 dynamics in an occupied room. A simplified linear model which describes the dynamics was developed by reformulating the physical equations into a linear regression format. This was followed by the employment of a suitable identification technique to estimate the physical parameters of the system. The second part of this thesis involves the formulation of a two level control architecture to optimize comfort and energy. In this work we propose a model-based framework to maximize the comfort of the occupants using the Predicted Mean Vote (PMV) index. In particular, the set-point control is based on a predictive controller based on a joint optimization of PMV and energy consumption; the low-level Proportional Integral HVAC controllers are autotuned based on simulations of a thermal model. A simulation based validation via a three room test case is presented: the results show the potential for good temperature tracking with a high degree of comfort while also reducing overall energy consumption.
- An Energy-Harvesting Facade Optimization System for Built Environments
Name: Atul Pandaravila Biju
Description: Daylighting is the immediate exploitation of solar energy in the form of natural lighting and plays an integral role in minimizing the energy footprint of a building. Smart daylighting enables us to design buildings that provide comfort and energy savings. This work proposes a dynamic facade system for buildings which aims to maximize user comfort while simultaneously maximizing energy savings by harvesting solar energy optimally. The solar panels on the facade can harvest the highest amount of energy when it is positioned perpendicular to the sun’s rays. However, this may result in unsatisfactory lighting conditions inside the room and the problem is approached as a bi-objective optimization problem. This work is a preliminary exploration of the concept of smart skins for buildings that autonomously regulates light while harvesting solar energy, contributing to the creation of the future of sustainable buildings. The primary focus of this research work revolves around building a conceptual model, formulating an optimization problem, developing a control algorithm, iFOS, and then evaluating it. Data was simulated using advanced simulations to evaluate the dynamics of light indoors. Two benchmarks were created to evaluate the algorithm against, one where the system works towards maximizing user comfort indoors, and the other, where the system works to maximize the energy harvested by the facade. Upto 8% increase in the energy harvested was achieved with minimal loss in user comfort in the use case evaluated. The average energy figure for The Netherlands in the summer months is about 5 kW h/m2/day, which makes the total energy that can be captured at 20% efficiency to be about 750 kWh per day. The algorithm is found to work the best when the desired light level to be maintained indoors lies in the range [400,600] lux.
- Solar Powered Passive Wireless Moisture Sensor with Cloud Communication
Name: Luis A. Moreira Cardoso
Studies have shown that fresh water is getting scarcer worldwide day by day. Most of the freshwater is being wasted on land e.g. for irrigation. Farmers waste so much fresh water, when watering their crops. To conserve water, measurements need to be done efficiently. However, soil moisture sensors currently available on the market are quite expensive and have high power consumption to be used in developing countries extensively.
Currently, ICT technologies moving at a rapid pace has resulted in a broad domain called, Internet of Things (IoT), which is becoming more and more ubiquitous. IoT is being deployed as part of smart solutions for purposes as remote monitoring and automation, to solve individual as well as social needs. In this work we present a new solar-powered passive moisture sensor, that is a low-cost alternative moisture sensor with low power consumption. To reduce the power consumption we took two approaches. Firstly, we target to reduce the power consumption during operation and secondly, we aim to harvest solar energy to prevent battery depletion.
The Passive moisture sensor measures the volumetric water content in soil by means of two electrodes composed of different metals, such as copper and zinc. The potential difference between the metals changes with the change of moisture in the soil. Since, the measurements are based on the potential difference between the metals there is no energy consumed by the node. We show that measurements performed by the passive moisture sensor correlates with the measurements performed by commercial moisture sensors, such as, the Decagon EC5. Our passive moisture sensor solution is at least 20% less expensive than other solutions currently available on the market. To reduce the energy consumption as much as possible, we let both main components of the sensor node, microcontroller and radio, duty cycle separately, since each of these components has its own independent task. Therefore, we have developed the Harmonic-Medium Access Control (H-MAC) protocol, which ensures that the duty cycle of both components do not conflict with each other, and allows the communication between the sensor nodes and the Cloud to be bi-directional. H-MAC makes the network scalable and resilient to failure. With H-MAC the radio has lower duty cycle, lower energy consumption and has lower latency than X-MAC. Further, to ensure that the batteries of the nodes last for as long as possible we powered the nodes with solar energy. Since, solar energy is lacks consistency and reliability we need to predict when will the sun provide enough energy to power the sensor nodes. We show that by using the weather forecast and inserting information about solar radiation and sunshine duration into our prediction model we get an improvement of the error rate of about 10% on the prediction
of solar energy availability.
In this work we provide convincing results that our passive moisture sensor is a low cost, low power alternative for the market. Our solution is affordable for developing countries.
- Location-aware Energy Disaggregation in Smart Homes
Name: Antonio Reyes Lua
Providing detailed appliance level energy consumption may lead consumers to understand their usage behavior and encourage them to optimize the energy usage. Non-intrusive load monitoring (NILM) or energy disaggregation aims to estimate appliance level energy consumption from aggregate consumption data of households. Hitherto, proposed NILM algorithms are either centralized or require high performance systems to derive appliance level data, owing to the computational complexity associated. This approach raises several issues related to scalability and privacy of consumer’s data.
In this thesis, we present the NILM-Loc Framework that utilizes occupancy of users to derive accurate appliance level usage information. NILMLoc framework limits the appliances considered for disaggregation based on the current location of the occupants. Thus, it can provide real-time feedback on appliance level energy consumption and run on an embedded system locally at the household. We propose several accuracy metrics to study the performance of NILM-Loc. To test its robustness, we empirically evaluated it across multiple publicly available datasets. NILM-Loc has significantly higher energy disaggregation accuracy while exponentially reducing the computational complexity. NILM-Loc presents accuracy improvements up to 30% better than other traditional methods. It reaches an accuracy of 89% for the evaluated datasets.
We also detail a case study for the use of the fine-grained appliance-level energy information obtained. We present a load scheduler that minimizes cost and discomfort based on hourly day-ahead pricing. The proposed Demand Response (DR) system ensures user discomfort is minimized by abstracting patterns from past user behavior and incorporating them to the designed cost-optimal schedule.
- Energy Allocation Strategies for Micro-Grids
Name: Nikolaos Kouvelas
The advances of the information and communication technology (ICT) brought changes in the energy distribution domain, introducing the Smart Grid (SG). In SG, generators, distributors, and consumers communicate in a bidirectional way. SGs are envisaged to include micro-grids (MG) consisting of distributed control networks of consumers, producers, and the power grid. Two-way communication in MGs offers the opportunity to allocate the produced energy inside a community of consumers, and, as a result, make the energy flow less dependent on the central grid. However, challenges arise regarding energy sharing, namely: (i) how to balance the demand and supply inside communities; (ii) how to dictate the impact –for the community– of serving the needs of a household; and (iii) how to balance the economic benefit –under a policy– for everyone who participates. In this thesis, we propose energy allocation algorithms for MG communities consisting of households that use renewable sources of energy (RSEs). Our objective is to maximize the usage of the energy created by the producers inside the community and minimize the cost, under certain priority policies. Through an in-depth analysis of energy and socioeconomic data of the community, we form groups of households that share similar characteristics. Since these groups share similar energy trends, we can decide the (group of) consumers that should be served first or that should accept higher amounts of energy than the rest, by dictating consumer priority policies (CPPs). Then, after defining the value of serving each consumer inside the community (by imposing a CPP), we create energy allocation strategies (EASs). These are algorithms which define the way in which the produced energy will be distributed, based on the already imposed CPP. We present seven, simple and optimized, EASs and several consumer priority policies (CPPs). Our EASs and CPPs are scalable and can meet the specific needs of an MG community. We evaluate our algorithms and techniques using real data, acquired from a community of 443 households over a year. We show that the groups of households that we prioritize cover their needs of energy, sometimes completely, in periods of high energy production. We compare the cost of trading energy within the MG and requesting energy from the grid (classic way). The expenses for prioritized groups of consumers under our EASs are decreased, up to 50% in certain cases. Further, it is shown that even the non-prioritized consumers benefit economically by allocating the excess of energy.
- ‘Adaptive thermal comfort opportunities for dwellings: Providing thermal comfort only when and where needed in dwellings in the Netherlands’
Name: Noortje Aalbers
The aim of the research presented in this thesis is to design the characteristics of an Adaptive Thermal Comfort System for Dwellings to achieve a significantly better energy performance whilst not compromising the thermal comfort perception of the occupants. An Adaptive Thermal Comfort System is defined as the whole of passive and active comfort components of the dwelling that dynamically adapts its settings to varying user comfort demands and weather conditions (seasonal, diurnal and hourly depending on the aspects adapted), thus providing comfort only where, when and at the level needed by the user, to improve possibilities of harvesting the environmental energy (e.g. solar gain and outdoor air) when available and storing it when abundant. In order to be able to create an Adaptive Thermal Comfort System to save energy knowledge is needed as to where, when, what kind and how much energy is needed to provide the thermal comfort. Therefore, this research aimed to gain insight in the dynamic behavior of the weather and the occupant and the opportunities to design the characteristics of an Adaptive Thermal Comfort System for Dwellings to achieve a significantly better energy performance whilst not compromising the thermal comfort perception of the occupants answering the main research question; What are the most efficient strategies for delivering thermal comfort in the residential sector with respect to better energy performances and an increasing demand for flexibility in use and comfort conditions?
- Virtualizing The Internet of Things
Name: C. Sarkar
Computers were invented to automate the labour-intensive computing process. The advancement of semiconductor technology has reduced the form-factor and cost of computers, and increased their usability. This has gradually introduced computers in various control and automation systems. The further rise of miniatuarized computing devices paves the way for autonomous monitoring using embedded devices. In the last two decades, we observed a huge surge of such monitoring and control systems. These systems are generally termed as the wireless sensor and actuator networks (WSAN). In a WSAN, a number of sensor nodes monitors a deployment area where data collection by humans is either difficult or costly. These devices collaboratively report their sensor readings to a centralized node called the sink. The sink is connected with the Internet, thus delivers the data to the outside world. This way the deployment region can be monitored remotely. Similarly, some actuators can also be controlled remotely through the sink.In the last decade, the concept of the Internet of Things (IoT) has evolved where any device can be reached by any other device/system/human being from anywhere and anytime. Thus, WSANs can be seen as a precursor of IoT. However, the vision of IoT is not limited to mere remote connectivity. Unlike traditional WSAN, where devices are deployed in remote/critical locations for specific purposes, IoT devices would be integrated into our daily surroundings assisting us in every aspect of life. As the embedded devices are resource constrained, energy and computational efficiency is a major challenge for both WSAN and IoT devices. However, the problem escalates as the IoT devices are expected to perform a number of tasks as opposed to a specific task as performed by classical WSANs. Moreover, the goal of IoT is to take humans out of the control loop or reduce the human intervention as much as possible. This requires devices to exchange data and cooperate among themselves. Thus, IoT devices need to act smartly fulfilling various requirements within its resource constraints. Every existing and upcoming device and network would be part of the IoT ecosystem. As the number of devices is expected to grow multifold, managing these devices will be a challenge. Especially since these devices are under the control of various entities/organizations. Not to mention that the manufacturers of various devices and their specifications would also vary significantly. To accomplish the vision of IoT these devices need to be able to cooperate and collaborate among themselves even if they are managed differently. This thesis brings forward the concept of virtualization in IoT to tackle the challenges of a global IoT ecosystem. The first challenge that we tackle is how to virtualize the IoT. We propose a reference architectural model for IoT called DIAT. The reference architecture follows a layered design principle where each layer groups a number of similar functionalities together. This enables easy development of existing and new functionalities of each layer independently. To validate the feasibility and usability of such an architectural model, we developed a system based on a practical IoT-application scenario. To this extent, we developed a controller (iLTC) that operates the heating and lighting systems in an office environment such that these devices operate energy efficiently. At the same time the system ensures a comfortable surroundings for the occupants while eliminating any direct involvement from the occupants. As WSANs are an integral part of the IoT ecosystem, next, we revisited some of the classic problems of WSANs in the wake of virtualizing the IoT. As energy efficiency is one of the biggest issues in WSANs, we propose a solution to reduce the overall traffic in a network without affecting the quality of data/monitoring. We achieved this by virtualizing the WSAN, which leads to higher cooperation among the devices and a higher operational optimization. We developed the virtual sensing framework (VSF) that exploits the inherent correlation among the sensor nodes to predict sensor readings (virtual sensing). The basic idea is that if a number of nodes are highly correlated, sensor readings from only one of them is sufficient to predict the readings for rest of them. Due to virtualization, such a cooperation among the nodes is possible. This reduces the amount of data transfer within the network, which leads to energy-efficient network operation. Further, we developed an efficient data collection protocol, called Sleeping Beauty that complements the virtualized sensor network. Based on a centralized schedule, nodes deliver their sensor readings to the sink reliably and efficiently. The accomplishment of a centralized schedule depends on network-wide time synchronization. As the hardware clock of an embedded device drifts significantly within a short time span, we developed a simple self-rectification mechanism such that the overhead of synchronizing the network periodically can be reduced significantly. This technique can be used by any protocol that requires time synchronization other than Sleeping Beauty. Timely data collection is another desired aspect of IoT as opposed to classical WSANs where latency is generally compromised in order to achieve a higher energy efficiency. We developed a communication mechanism, called Rapid that not only delivers the sensor readings in a fixed time bound, it also reduces the energy consumption. Rapid forms a number of clusters on-the-fly, where the cluster-heads collect data from the cluster-members and send an aggregated packet to the sink. By exploiting the capture effect, Rapid achieves parallelization for intra-cluster communications. Further, it exploits the constructive interference based fast flooding to deliver the aggregated data, which eliminates hop-by-hop flow scheduling. These two factors reduces the overall end-to-end delay of all the flows. The proposition of this thesis is that by means of virtualization, traditional WSANs can be easily integrated into the grand vision of IoT. We proposed a reference architecture, validated by means of a case study, and developed several amendments to classical WSAN data collection, making it consume less energy and achieve lower latency. We are convinced that virtualization can be applied effectively to other (WSAN) functionality as well. The future of IoT is looking bright.
- Personalized Energy Services: A Data-Driven Methodology towards Sustainable, Smart Energy Systems
Name: A.U.N. Srirangam Narashiman
The rapid pace of urbanization has an impact on climate change and other environmental issues. Currently, 54% of the global population lives in cities accounting for two-thirds of global energy demand. Sustainable energy generation and consumption is the top humanity’s problem for the next 50 years. Faced with rising urban population and the need to achieve energy efficiency, urban planners are focusing on sustainable, smart energy systems. This has led to the development of Smart Grids (SG) that employs intelligent monitoring, control and communication technologies to enhance efficiency, reliability and sustainability of power generation and distribution networks. While energy utilities are optimizing energy generation and distribution, consumers play a key role in sustainable energy usage. Several energy services are provided to the consumers to know households' hourly energy consumption, estimate monthly electricity cost and recommendations to reduce energy consumption. Furthermore, advanced services such as demand response, can now control and influence energy demand at the consumer-end to reduce the overall peak demand and re-shape demand profiles. The effectiveness and adoption of these services highly depend on the consumers’ awareness, their participation and engagement. Current energy services seldomly consider consumer preferences such as their daily behavior, comfort level and energy-consumption pattern. In this thesis, we investigate development of personalized energy services that strive to achieve a balance between efficient-energy consumption and user comfort. Personalization refers to tailoring energy services based on individual consumers’ characteristics, preferences and behavior. To develop effective personalized energy services a set of challenges need to be tackled. First, fine-grained data collection at user and appliance level is required (data collection challenge). Mechanisms should be devised to collect fine-grained data at various levels in a non-intrusive way with minimal sensors. Second, personalized energy services require detailed user preferences such as their thermal comfort level, appliance usage behavior and daily habits (user preference challenge). Accurate learning models to derive user preferences with minimal training and intrusion are required. Third, energy services developed needs to be easily scalable, from one household to tens and thousands of households (scalability challenge). Mechanisms should be developed to tackle the deluge of data and support distributed storage and processing. Fourth, energy services should deliver real-time feedback or recommendations so that users can promptly act upon it (real time challenge). This calls for development of distributed and low complexity algorithms. This thesis moves away from traditional SG services -- which hardly consider consumer preferences and comfort -- and proposes a novel approach to develop effective personalized energy services. The proposed energy services provide actionable feedback, raise awareness and promote energy-saving behavior among consumers. In this thesis, we follow a bottom-up data-driven methodology to develop personalized energy services at various scales -- (i) nano: individual households, (ii) micro: buildings and spaces, and (iii) macro: neighborhoods and cities. To this end, we present our approach -- physical analytics for sustainable, smart energy systems -- that combines IoT data, physical modeling and data analytics to develop intelligent, personalized energy services. Physical analytics fuses data from various Internet of Things (IoT) devices such as smart meters, smart phones and smart watches, along with physical information such as household type, demographics and occupancy to infer energy-usage patterns, user behavior and discover hidden patterns. This approach is used to learn and model user preferences and energy usage, subsequently, employed to develop personalized energy services. This thesis is organized into three parts. Part I describes how to derive fine-grained information with minimal sensors and intrusion. We present two novel algorithms viz., LocED and PEAT that derive fine-grained information from appliance and user level, respectively. This real-time information is used to raise awareness on energy-usage behavior among occupants. Part II presents personalized energy services targeted at households and buildings. We develop services that shift and/or reduce energy consumption and cost by considering individual consumers’ preferences and comfort. These energy services are aimed at providing actionable feedback to occupants towards sustainable energy usage. Part III presents energy services targeted at neighborhood and city level. These energy services aim to identify target consumers in a neighborhood based on their energy-usage pattern and preferences for various DR programs. Finally, we present data-processing architectures that investigate how to cope with the overwhelming data generated from smart meters towards design and development of sustainable, smart energy systems. This thesis advocates that the design and development of energy services should follow personalized approach with consumer preferences and comfort given paramount importance. Results show that the personalized energy services developed has significant potential to raise awareness, reduce energy consumption and improve user comfort in smart -- homes, buildings and neighborhoods.