Hi, my name is Mingxuan Song
I'm currently pursuing my PhD at Peking University.

Affiliations:
School of Computer Science, Peking University;
Alimama, Alibaba Group.

In recent years, Large Language Models (LLMs) have demonstrated remarkable performance across a variety of natural language processing tasks. However, fine-tuning these models typically requires large-scale datasets and extensive computational resources, which limits their applicability in scenarios where data is scarce and budgets are constrained. This work explores a novel approach to few-shot reinforcement learning (RL) fine-tuning for LLMs, aiming to adapt pre-trained models to specific tasks using minimal supervision.

Affiliations:
School of Computer Science, Peking University;
Theta Labs, Theta Inc.

Sharding blockchain systems face critical challenges in achieving efficient cross-shard data distribution and maintaining balanced workload across shards. Traditional address allocation methods often suffer from high latency and uneven shard utilization, especially when dealing with dynamically changing transaction patterns and reconfiguration events.

Affiliations:
School of Computer Science, Peking University;
Theta Labs, Theta Inc.

In the Web 3.0 era, NFTs have become a popular asset type, and the auction system is a crucial component of the NFT ecosystem. However, traditional auction systems often suffer from low throughput and high latency, especially when dealing with high-demand auctions. To address these challenges, we propose a hierarchical reinforcement learning approach to optimize dynamic bidding strategies, enabling more efficient and responsive NFT auctions.