Call for Papers // Committees // Speakers // NLLP 2023 // NLLP 2022 // NLLP 2021 // NLLP 2020 // NLLP 2019 //

Program

Workshop schedule

About

NLLP Workshop 2023 took place on 7 December 2023, co-located with the EMNLP 2023 conference.

The workshop proceedings are available here.

The recording of the workshop is available here:

The workshop program is available here.

[Jerrold Soh] (https://cclaw.smu.edu.sg/people/jerrold-soh) (Singapore Management University) was the invited speaker.

Sponsors:

Program

All times are in [SGT time zone]

09:00 - 10:30Session 1
09:00 - 09:10Workshop opening
09:10 - 09:15Anthropomorphization of AI: Opportunities and Risks
Ameet Deshpande, Tanmay Rajpurohit, Karthik Narasimhan and Ashwin Kalyan
09:15 - 09:20 Legal NLP Meets MiCAR: Advancing the Analysis of Crypto White Papers
Carolina Camassa
09:20 - 09:25On the Potential and Limitations of Few-Shot In-Context Learning to Generate Metamorphic Specifications for Tax Preparation Software
Dananjay Srinivas, Rohan Das, Saeid Tizpaz-Niari, Ashutosh Trivedi and Maria Leonor Pacheco
09:25 - 09:35Joint Q&A
09:35 - 09:40NOMOS: Navigating Obligation Mining in Official Statutes
Andrea Pennisi, Elvira González Hernández and Nina Koivula
09:40 - 09:45Long Text Classification using Transformers with Para Selection strategies
Mohit Tuteja and Daniel González Juclà
09:45 - 09:50Italian Legislative Text Classification for Gazzetta Ufficiale
Marco Rovera, Alessio Palmero Aprosio, Francesco Greco, Mariano Lucchese, Sara Tonelli and Antonio Antetomaso
09:50 - 09:55Towards Mitigating Perceived Unfairness in Contracts from a Non-Legal Stakeholder's Perspective
Anmol Singhal, Preethu Rose Anish, Shirish Karande and Smita Ghaisas
09:55 - 10:00Low-Resource Deontic Modality Classification in EU Legislation
Kristina Minkova, Shashank Chakravarthy and Gijs van Dijck
10:00 - 10:05Transferring Legal Natural Language Inference Model from a US State to Another: What Makes It So Hard?
Alice Kwak, Gaetano Vincent Forte, Derek E. Bambauer and Mihai Surdeanu
10:05 - 10:10Legally Enforceable Hate Speech Detection
Chu Fei Luo, Rohan Bhambhoria, Samuel Dahan, Xiaodan Zhu
10:10 - 10:15More than Votes? Voting and Language based Partisanship in the US Supreme Court
Biaoyan Fang, Trevor Cohn, Timothy Baldwin, Lea Frermann
10:15 - 10:30Joint Q&A
10:30 - 11:00Break
11:00 - 12:30Session 2
11:00 - 11:05 Retrieval-Augmented Chain-of-Thought in Semi-structured Domains
Vaibhav Mavi, Abulhair Saparov and Chen Zhao
11:05 - 11:10Mixed-domain Language Modeling for Processing Long Legal Documents
Wenyue Hua, Yuchen Zhang, Zhe Chen, Josie Li and Melanie Weber
11:10 - 11:15 Large Language Models are legal but they are not: Underscoring the need for better Legal LLMs
Thanmay Jayakumar, Fauzan Farooqui and Luqman Farooqui
11:15 - 11:20 Exploration of Open Large Language Models for eDiscovery
Sumit Pai, Sounak Lahiri, Ujjwal Kumar, Krishanu Das Baksi, Elijah Soba, Michael Suesserman, Nirmala Pudota, Jon Foster, Edward Bowen and Sanmitra Bhattacharya
11:20 - 11:25 A Comparative Study of Prompting Strategies for Legal Text Classification
Ali Hakimi Parizi, Yuyang Liu, Prudhvi Nokku, Sina Gholamian and David Emerson
11:25 - 11:30 A Comprehensive Evaluation of Large Language Models on Legal Judgment Prediction
Ruihao Shui, Yixin Cao, Xiang Wang, Tat-Seng Chua
11:30 - 11:40Joint Q&A
11:40 - 11:45 SCALE: Scaling up the Complexity for Advanced Language Model Evaluation
Vishvaksenan Rasiah, Ronja Stern, Veton Matoshi, Matthias Stürmer, Ilias Chalkidis, Daniel Ho and Joel Niklaus
11:45 - 11:50 Super-SCOTUS: A multi-sourced dataset for the Supreme Court of the US
Biaoyan Fang, Trevor Cohn, Timothy Baldwin and Lea Frermann
11:50 - 11:55 MultiLegalPile: A 689GB Multilingual Legal Corpus
Joel Niklaus, Veton Matoshi, Matthias Stürmer, Ilias Chalkidis and Daniel Ho
11:55 - 12:00 ECtHR-PCR: A Dataset for Precedent Understanding and Prior Case Retrieval in the European Court of Human Rights
Santosh T.Y.S.S, Rashid Haddad and Matthias Grabmair
12:00 - 12:05 AsyLex: A Dataset for Legal Language Processing of Refugee Claims
Claire Barale, Mark Klaisoongnoen, Pasquale Minervini, Michael Rovatsos and Nehal Bhuta
12:05 - 12:10 LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domain
Joel Niklaus, Veton Matoshi, Pooja Rani, Andrea Galassi, Matthias Stürmer, Ilias Chalkidis
12:10 - 12:30Joint Q&A
12:30 - 14:00Lunch & In-Person Poster Session (Lunch provided)
14:00 - 15:30Session 3
14:00 - 15:00Keynote Talk
Jerrold Soh - NLP in the Legal World
15:00 - 15:05 Retrieval-based Evaluation for LLMs: A Case Study in Korean Legal QA
Cheol Ryu, Seolhwa Lee, Subeen Pang, Chanyeol Choi, Hojun Choi, Myeonggee Min and Jy-yong Sohn
15:05 - 15:10 Joint Learning for Legal Text Retrieval and Textual Entailment: Leveraging the Relationship between Relevancy and Affirmation
Nguyen Hai Long, Thi Hai Yen Vuong, Ha Thanh Nguyen and Xuan-Hieu Phan
15:10 - 15:15 Tracing Influence at Scale: A Contrastive Learning Approach to Linking Public Comments and Regulator Responses
Linzi Xing, Brad Hackinen and Giuseppe Carenini
15:15 - 15:20 The Law and NLP: Bridging Disciplinary Disconnects
Robert Mahari, Dominik Stammbach, Elliott Ash, Alex Pentland
15:20 - 15:30Joint Q&A
15:30 - 16:00Break
16:00 - 17:30Session 4
16:00 - 16:05 Towards Explainability and Fairness in Swiss Judgement Prediction: Benchmarking on a Multilingual Dataset
Santosh T.Y.S.S, Nina Baumgartner, Matthias Stürmer, Matthias Grabmair and Joel Niklaus
16:05 - 16:10 LLMs -- the Good, the Bad or the Indispensable?: A Use Case on Legal Statute Prediction and Legal Judgment Prediction on Indian Court Cases
Shaurya Vats, Atharva Zope, Somsubhra De, Anurag Sharma, Upal Bhattacharya, Shubham Kumar Nigam, Shouvik Kumar Guha, Koustav Rudra, Kripabandhu Ghosh
16:10 - 16:15 Exploiting Contrastive Learning and Numerical Evidence for Confusing Legal Judgment Prediction
Leilei Gan, Baokui Li, Kun Kuang, Yating Zhang, Lei Wang, Anh Tuan Luu, Yi Yang, Fei Wu
16:15 - 16:20 Multi-Defendant Legal Judgment Prediction via Hierarchical Reasoning
Yougang Lyu, Jitai Hao, Zihan Wang, Kai Zhao, Shen Gao, Pengjie Ren, Zhumin Chen, Fang Wang, Zhaochun Ren
16:20 - 16:25 Pretrained Language Models v. Court Ruling Predictions: A Case Study on a Small Dataset of French Court of Appeal Rulings
Olivia Vaudaux, Caroline Bazzoli, Maximin Coavoux, Géraldine Vial and Étienne Vergès
16:25 - 16:30 Legal Judgment Prediction: If You Are Going to Do It, Do It Right
Masha Medvedeva and Pauline McBride
16:30 - 16:35 Extracting Sentencing-Related Factors from Criminal Cases in Hebrew
Din Ezra, Maxim Bragilovski, Itay Razumenko, Keren Gorelik, Lior Kobi, Lior Rokach, Arnon Strum and Nir Grinberg
16:35 - 16:40Joint Q&A
16:40 - 16:45 Do Language Models Learn about Legal Entity Types during Pretraining?
Claire Barale, Michael Rovatsos and Nehal Bhuta
16:45 - 16:50 Questions about Contracts: Prompt Templates for Structured Answer Generation
Adam Roegiest, Radha Chitta, Jonathan Donnelly, Maya Lash, Alexandra Vtyurina and Francois Longtin
16:50 - 16:55 Resolving Legalese: A Multilingual Exploration of Negation Scope Resolution in Legal Documents
Ramona Christen, Anastassia Shaitarova, Matthias Stürmer and Joel Niklaus
16:55 - 17:00 Beyond The Text: Analysis of Privacy Statements through Syntactic and Semantic Role Labeling
Yan Shvartzshanider, Ananth Balashankar, Thomas Wies and Lakshminarayanan Subramanian
17:00 - 17:05 Connecting Symbolic Statutory Reasoning with Legal Information Extraction
Nils Holzenberger and Benjamin Van Durme
17:05 - 17:10 Automatic Anonymization of Swiss Federal Supreme Court Rulings
Joel Niklaus, Robin Mamié, Matthias Stürmer, Daniel Brunner and Marcel Gygli
17:10 - 17:15 Can ChatGPT Perform Reasoning Using the IRAC Method in Analyzing Legal Scenarios Like a Lawyer?
Xiaoxi Kang, Lizhen Qu, Lay-Ki Soon, Adnan Trakic, Terry Yue Zhuo, Patrick Charles Emerton, Genevieve Grant
17:15 - 17:20 Information Extraction from Legal Wills: How Well Does GPT-4 Do?
Alice Saebom Kwak, Cheonkam Jeong, Gaetano Vincent Forte, Derek Bambauer, Clayton T Morrison, Mihai Surdeanu
17:20 - 17:30Joint Q&A
17:30 - 17:35Best Presentation Award

Committees

Organizing Committee

Program Committee