{"id":3153,"date":"2024-03-19T13:44:17","date_gmt":"2024-03-19T13:44:17","guid":{"rendered":"https:\/\/lassonde.yorku.ca\/eecs\/?post_type=mec-events&p=3153"},"modified":"2025-05-26T14:11:46","modified_gmt":"2025-05-26T14:11:46","slug":"reyhan","status":"publish","type":"mec-events","link":"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/","title":{"rendered":"Reyhan Jabbarvand Behrouz"},"content":{"rendered":"

AI + SE Seminar Series ( August 30, 2024 11am EST).<\/p>\n

\n

Beyond Crafted Benchmarks, Using LLMs to Automate Software Engineering Tasks in Real-World Projects<\/h3>\n<\/div>\n
\n

Large Language Models (LLMs) are the new automation technology to explore for software development and maintenance. State-of-the-art LLMs and techniques leveraging them for code-related tasks are mostly evaluated on crafted benchmarks (mostly not reflective of the complexity of real-world projects) and under very simple tasks (even if the studied programs are real-world projects, the tasks are very simple). In this presentation, I will first talk about the challenges of using LLMs for (1) whole-repository code translation and (2) code synthesis for repairing test flakiness in real-world projects. After discussing such challenges, I will talk about how neuro-symbolic approaches that combine the generalizability of LLMs and the soundness of program analysis can overcome these challenges.<\/p>\n<\/div>\n

Bio<\/h3>\n

Reyhan Jabbarvand is an Assistant Professor of Computer Science at the University of Illinois, Urbana-Champaign. Her research interests lie at the intersection of Program Analysis and Artificial Intelligence. Reyhan received her PhD from the University of California, Irvine, where her research on energy testing of mobile applications was recognized by a Google PhD Fellowship. As a faculty, she has been the recipient of the NSF CAREER award, and her research has been supported by grants from NSF, IBM, and C3.ai.<\/p>\n

For more details, please visit: https:\/\/reyhaneh.cs.illinois.edu\/<\/a><\/p>\n

EECS Upcoming Events: https:\/\/lassonde.yorku.ca\/eecs\/eecs-upcoming-events\/<\/a><\/p>\n

Video Recording: Here<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

AI + SE Seminar Series ( August 30, 2024 11am EST). Beyond Crafted Benchmarks, Using LLMs to Automate Software Engineering Tasks in Real-World Projects Large Language Models (LLMs) are the new automation technology to explore for software development and maintenance. State-of-the-art LLMs and techniques leveraging them for code-related tasks are mostly evaluated on crafted benchmarks…<\/p>\n","protected":false},"author":264,"featured_media":3163,"comment_status":"closed","ping_status":"closed","template":"","tags":[],"mec_category":[],"class_list":["post-3153","mec-events","type-mec-events","status-publish","has-post-thumbnail","hentry"],"yoast_head":"\nReyhan Jabbarvand Behrouz | Electrical Engineering and Computer Science<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Reyhan Jabbarvand Behrouz | Electrical Engineering and Computer Science\" \/>\n<meta property=\"og:description\" content=\"AI + SE Seminar Series ( August 30, 2024 11am EST). Beyond Crafted Benchmarks, Using LLMs to Automate Software Engineering Tasks in Real-World Projects Large Language Models (LLMs) are the new automation technology to explore for software development and maintenance. State-of-the-art LLMs and techniques leveraging them for code-related tasks are mostly evaluated on crafted benchmarks...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/\" \/>\n<meta property=\"og:site_name\" content=\"Electrical Engineering and Computer Science\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-26T14:11:46+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/lassonde.yorku.ca\/eecs\/wp-content\/uploads\/sites\/6\/2024\/03\/7.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1255\" \/>\n\t<meta property=\"og:image:height\" content=\"1689\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/\",\"url\":\"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/\",\"name\":\"Reyhan Jabbarvand Behrouz | Electrical Engineering and Computer Science\",\"isPartOf\":{\"@id\":\"https:\/\/lassonde.yorku.ca\/eecs\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/lassonde.yorku.ca\/eecs\/wp-content\/uploads\/sites\/6\/2024\/03\/7.jpg\",\"datePublished\":\"2024-03-19T13:44:17+00:00\",\"dateModified\":\"2025-05-26T14:11:46+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/#primaryimage\",\"url\":\"https:\/\/lassonde.yorku.ca\/eecs\/wp-content\/uploads\/sites\/6\/2024\/03\/7.jpg\",\"contentUrl\":\"https:\/\/lassonde.yorku.ca\/eecs\/wp-content\/uploads\/sites\/6\/2024\/03\/7.jpg\",\"width\":1255,\"height\":1689,\"caption\":\"Reyhan Jabbarvand Behrouz\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/lassonde.yorku.ca\/eecs\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Events\",\"item\":\"https:\/\/lassonde.yorku.ca\/eecs\/events\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Reyhan Jabbarvand Behrouz\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/lassonde.yorku.ca\/eecs\/#website\",\"url\":\"https:\/\/lassonde.yorku.ca\/eecs\/\",\"name\":\"Electrical Engineering and Computer Science\",\"description\":\"Just another Lassonde - Site Network Sites site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/lassonde.yorku.ca\/eecs\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Reyhan Jabbarvand Behrouz | Electrical Engineering and Computer Science","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/","og_locale":"en_US","og_type":"article","og_title":"Reyhan Jabbarvand Behrouz | Electrical Engineering and Computer Science","og_description":"AI + SE Seminar Series ( August 30, 2024 11am EST). Beyond Crafted Benchmarks, Using LLMs to Automate Software Engineering Tasks in Real-World Projects Large Language Models (LLMs) are the new automation technology to explore for software development and maintenance. State-of-the-art LLMs and techniques leveraging them for code-related tasks are mostly evaluated on crafted benchmarks...","og_url":"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/","og_site_name":"Electrical Engineering and Computer Science","article_modified_time":"2025-05-26T14:11:46+00:00","og_image":[{"width":1255,"height":1689,"url":"https:\/\/lassonde.yorku.ca\/eecs\/wp-content\/uploads\/sites\/6\/2024\/03\/7.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/","url":"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/","name":"Reyhan Jabbarvand Behrouz | Electrical Engineering and Computer Science","isPartOf":{"@id":"https:\/\/lassonde.yorku.ca\/eecs\/#website"},"primaryImageOfPage":{"@id":"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/#primaryimage"},"image":{"@id":"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/#primaryimage"},"thumbnailUrl":"https:\/\/lassonde.yorku.ca\/eecs\/wp-content\/uploads\/sites\/6\/2024\/03\/7.jpg","datePublished":"2024-03-19T13:44:17+00:00","dateModified":"2025-05-26T14:11:46+00:00","breadcrumb":{"@id":"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/#primaryimage","url":"https:\/\/lassonde.yorku.ca\/eecs\/wp-content\/uploads\/sites\/6\/2024\/03\/7.jpg","contentUrl":"https:\/\/lassonde.yorku.ca\/eecs\/wp-content\/uploads\/sites\/6\/2024\/03\/7.jpg","width":1255,"height":1689,"caption":"Reyhan Jabbarvand Behrouz"},{"@type":"BreadcrumbList","@id":"https:\/\/lassonde.yorku.ca\/eecs\/events\/reyhan\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/lassonde.yorku.ca\/eecs\/"},{"@type":"ListItem","position":2,"name":"Events","item":"https:\/\/lassonde.yorku.ca\/eecs\/events\/"},{"@type":"ListItem","position":3,"name":"Reyhan Jabbarvand Behrouz"}]},{"@type":"WebSite","@id":"https:\/\/lassonde.yorku.ca\/eecs\/#website","url":"https:\/\/lassonde.yorku.ca\/eecs\/","name":"Electrical Engineering and Computer Science","description":"Just another Lassonde - Site Network Sites site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/lassonde.yorku.ca\/eecs\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/lassonde.yorku.ca\/eecs\/wp-json\/wp\/v2\/mec-events\/3153","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lassonde.yorku.ca\/eecs\/wp-json\/wp\/v2\/mec-events"}],"about":[{"href":"https:\/\/lassonde.yorku.ca\/eecs\/wp-json\/wp\/v2\/types\/mec-events"}],"author":[{"embeddable":true,"href":"https:\/\/lassonde.yorku.ca\/eecs\/wp-json\/wp\/v2\/users\/264"}],"replies":[{"embeddable":true,"href":"https:\/\/lassonde.yorku.ca\/eecs\/wp-json\/wp\/v2\/comments?post=3153"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/lassonde.yorku.ca\/eecs\/wp-json\/wp\/v2\/media\/3163"}],"wp:attachment":[{"href":"https:\/\/lassonde.yorku.ca\/eecs\/wp-json\/wp\/v2\/media?parent=3153"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lassonde.yorku.ca\/eecs\/wp-json\/wp\/v2\/tags?post=3153"},{"taxonomy":"mec_category","embeddable":true,"href":"https:\/\/lassonde.yorku.ca\/eecs\/wp-json\/wp\/v2\/mec_category?post=3153"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}