📣 𝐂𝐚𝐥𝐥 𝐟𝐨𝐫 𝐏𝐚𝐫𝐭𝐢𝐜𝐢𝐩𝐚𝐭𝐢𝐨𝐧: 𝐋𝐋𝐌𝟒𝐇𝐖𝐃𝐞𝐬𝐢𝐠𝐧 𝐂𝐨𝐧𝐭𝐞𝐬𝐭 @ 𝐈𝐂𝐂𝐀𝐃 𝟐𝟎𝟐𝟒! We are thrilled to announce the launch of the LLM4HWDesign Contest @ ICCAD 2024, organized by the EIC Lab @ GaTech and Nvidia! Goal We aim to harness community efforts to develop an open-source, large-scale, high-quality dataset that facilitates innovations in large language model (LLM)-based hardware […]
Category: News
Two Papers on Efficient Large Language Models Were Presented at ICML 2024!
📢 [𝐈𝐂𝐌𝐋 𝟐𝟎𝟐𝟒] If you are interested in faster and more energy-efficient large language models (LLMs), we invite you to check out the following two papers we presented at ICML 2024! Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibration Motivation The attention mechanism is crucial in LLMs, yet […]
MG-Verilog (Dataset Released) Won the Best Paper Award at the First IEEE International Workshop on LLM-Aided Design (LAD’24)!
🚀 We are excited to release the 𝗠𝗚-𝗩𝗲𝗿𝗶𝗹𝗼𝗴 dataset for LLM-assisted Verilog code generation, as presented in our paper, “𝗠𝗚-𝗩𝗲𝗿𝗶𝗹𝗼𝗴: 𝗠𝘂𝗹𝘁𝗶-𝗴𝗿𝗮𝗶𝗻𝗲𝗱 𝗗𝗮𝘁𝗮𝘀𝗲𝘁 𝗧𝗼𝘄𝗮𝗿𝗱𝘀 𝗘𝗻𝗵𝗮𝗻𝗰𝗲𝗱 𝗟𝗟𝗠-𝗮𝘀𝘀𝗶𝘀𝘁𝗲𝗱 𝗩𝗲𝗿𝗶𝗹𝗼𝗴 𝗚𝗲𝗻𝗲𝗿𝗮𝘁𝗶𝗼𝗻,” which won 𝘁𝗵𝗲 𝗕𝗲𝘀𝘁 𝗣𝗮𝗽𝗲𝗿 𝗔𝘄𝗮𝗿𝗱 at the First IEEE International Workshop on LLM-Aided Design (LAD’24)! Please feel free to try our ready-to-use dataset at HuggingFace. Motivation The […]