Lectures related to Policy studies

Evolution of Migration Policy: Analysis and Evaluation

Covers assignments for tracing migration policy evolution and evaluating its impact.

Multi-arm Bandits: Exploration vs Exploitation

Explores the balance between exploration and exploitation in multi-arm bandit algorithms.

Policy, People, Technology: Future of Mobility

Explores the future of mobility through policy, people, and technology.

Innovative Governance of Large Urban Systems

Delves into the governance of large urban systems and the future of mobility, addressing challenges and new business models.

Research Paper Assignment: Policy Evolution in Migration Governance

Explains the second-semester research paper assignment on analyzing policy evolution in migration governance.

Towards Sustainable Composites

Explores sustainable composite solutions, including recycling, end-of-life strategies, and hydrogen storage.

Relation of SARSA and Bellman equation

Explores the relation between fluctuating Q-values in SARSA and the Bellman equation through expectations and policy constancy.

Mechanical Search on Shelves: Efficient Stacking and Destacking

Discusses optimizing object retrieval in cluttered environments using efficient stacking and destacking techniques.

Planning the First Draft

Covers the basic requirements for the first draft and guides students on project planning and outlining techniques.

Dynamic Programming: Optimal Control

Explores Dynamic Programming for optimal control, focusing on stability, stationary policy, and recursive solutions.

Hidden Exposure: Measuring US Supply Chain Reliance

Explores the hidden exposure of US supply chains to foreign suppliers and the importance of simplifying complex realities through mental models.

Inventory Management

Covers the (s,s)-inventory model, stationary Markov chains, time reversal property, and detailed balance condition.

Unintended Consequences of Technology in Global South

Examines unintended negative impacts of technology in sustainable development, addressing challenges and consequences in the Global South.

Reinforcement Learning: TD Learning and SARSA Variants

Discusses reinforcement learning, focusing on temporal difference learning and SARSA algorithm variations.

Scalable Multi-query Execution: Reinforcement Learning Approach

Presents a novel approach to scalable multi-query execution using reinforcement learning.

Biodiversity and Infrastructure: Eco-services

Delves into biodiversity, ecosystem services, economic valuation, and sustainable infrastructure policies.

Technological Levers for Sustainability: Energy and Policy

Covers the impact of technological levers on sustainability, focusing on energy consumption and climate change.

Smart Urban Energy Systems

Covers the conceptualization of smart urban energy systems and their three layers.

Model-Free Prediction in Reinforcement Learning: Key Methods

Covers model-free prediction methods in reinforcement learning, focusing on Monte Carlo and Temporal Differences for estimating value functions without transition dynamics knowledge.

Monetary Policy Analysis

Covers the analysis of monetary policy responses to public debt accumulation and includes a project on evaluating alternative policies.