Advertisement · 728 × 90
#
Hashtag
#Grammars
Advertisement · 728 × 90

Physics of Language Models: Part 1, Learning Hierarchical Language Structures

Zeyuan Allen-Zhu, Yuanzhi Li

Action editor: Jonathan Berant

https://openreview.net/forum?id=mPQKyzkA1K

#parsing #parse #grammars

2 0 0 0
Physics of Language Models: Part 1, Learning Hierarchical Language Structures

Physics of Language Models: Part 1, Learning Hierarchical Language Structures

New #TMLR-Paper-with-Video:

Physics of Language Models: Part 1, Learning Hierarchical Language Structures

Zeyuan Allen-Zhu, Yuanzhi Li

https://tmlr.infinite-conf.org/paper_pages/mPQKyzkA1K

#parsing #parse #grammars

0 0 0 0
Post image

#scribaland LOVE SONG FOR ETERNITY
The #miracle of this love song! Whenever you hear it, you must open your #eyes, wherever you are! #scribaland1 #love #song #eternity #faculty #faculties #galeries #game #games #gaming #genius #grammar #grammars #grammatical #google #googleadvertising #googleadwords

0 0 0 0
Post image

#scribaland REVOLUTION OF IDIOTS
Morons are never unemployed nor retired! This human bullshit ruins lives and causes so much damage! #scribaland1 #revolution #idiots #forums #fact #facts #faculty #faculties #galerie #galeries #game #games #gaming #genius #grammar #grammars #grammatical #audible #art

1 0 0 0
Post image

#scribaland A PLUNGED WORLD INTO DARKNESS?
After a #blackout in a #darkworld? #scribaland1 #plungedworld #darkness #aplungedworldintodarkness #films #flickr #forum #forums #fact #facts #faculty #faculties #galerie #galeries #game #games #gaming #genius #grammar #grammars #grammatical #google #figure

1 0 0 0
Post image

#scribaland DECLINING OF MANHOOD
The #fallofman empire? #scribaland1 #declining #manhood #decliningofmanhood #appleadvertising #applebook #applebooks #applemusic #appleplay #appletv #appletvplus #artgalery #artgaleries #audiobook #grammars #grammatical #google #googleadvertising #genius #grammar #ai

0 0 0 0
Post image

#scribaland ECOLOGICAL-ANXIETY
Is eco-anxiety a new #disease of #climatecrisis? #scribaland1 #ecological #anxiety #forum #forums #fact #facts #faculty #faculties #galerie #galeries #game #games #gaming #genius #grammar #grammars #grammatical #college #colleges #interviewer #interviewers #institutes

0 0 0 0
FANDANGO: Evolving Language-Based Testing
José Antonio Zamudio Amaya, Marius Smytzek, Andreas Zeller

Language-based fuzzers leverage formal input specifications (languages) to generate arbitrarily large and diverse sets of valid inputs for a program under test. Modern language-based test generators combine grammars and constraints to satisfy syntactic and semantic input constraints. ISLa, the leading input generator in that space, uses symbolic constraint solving to solve input constraints. Using solvers places ISLa among the most precise fuzzers but also makes it slow.

In this paper, we explore search-based testing as an alternative to symbolic constraint solving. We employ a genetic algorithm that iteratively generates candidate inputs from an input specification, evaluates them against defined constraints, evolving a population of inputs through syntactically valid mutations and retaining those with superior fitness until the semantic input constraints are met. This evolutionary procedure, analogous to natural genetic evolution, leads to progressively improved inputs that cover both semantics and syntax. This change boosts the efficiency of language-based testing: In our experiments, compared to ISLa, our search-based FANDANGO prototype is faster by one to three orders of magnitude without sacrificing precision...

FANDANGO: Evolving Language-Based Testing José Antonio Zamudio Amaya, Marius Smytzek, Andreas Zeller Language-based fuzzers leverage formal input specifications (languages) to generate arbitrarily large and diverse sets of valid inputs for a program under test. Modern language-based test generators combine grammars and constraints to satisfy syntactic and semantic input constraints. ISLa, the leading input generator in that space, uses symbolic constraint solving to solve input constraints. Using solvers places ISLa among the most precise fuzzers but also makes it slow. In this paper, we explore search-based testing as an alternative to symbolic constraint solving. We employ a genetic algorithm that iteratively generates candidate inputs from an input specification, evaluates them against defined constraints, evolving a population of inputs through syntactically valid mutations and retaining those with superior fitness until the semantic input constraints are met. This evolutionary procedure, analogous to natural genetic evolution, leads to progressively improved inputs that cover both semantics and syntax. This change boosts the efficiency of language-based testing: In our experiments, compared to ISLa, our search-based FANDANGO prototype is faster by one to three orders of magnitude without sacrificing precision...

What do you get if you combine #grammars, #constraints, #evolutionary algorithms, and #Python in one? A mighty fuzzer! Check out our latest #FANDANGO work, to appear at #ISSTA2025 […]

[Original post on mastodon.social]

1 0 0 0
FANDANGO: Evolving Language-Based Testing
José Antonio Zamudio Amaya, Marius Smytzek, Andreas Zeller

Language-based fuzzers leverage formal input specifications (languages) to generate arbitrarily large and diverse sets of valid inputs for a program under test. Modern language-based test generators combine grammars and constraints to satisfy syntactic and semantic input constraints. ISLa, the leading input generator in that space, uses symbolic constraint solving to solve input constraints. Using solvers places ISLa among the most precise fuzzers but also makes it slow.

In this paper, we explore search-based testing as an alternative to symbolic constraint solving. We employ a genetic algorithm that iteratively generates candidate inputs from an input specification, evaluates them against defined constraints, evolving a population of inputs through syntactically valid mutations and retaining those with superior fitness until the semantic input constraints are met. This evolutionary procedure, analogous to natural genetic evolution, leads to progressively improved inputs that cover both semantics and syntax. This change boosts the efficiency of language-based testing: In our experiments, compared to ISLa, our search-based FANDANGO prototype is faster by one to three orders of magnitude without sacrificing precision.

The search-based approach no longer restricts constraints to constraint solvers' (miniature) languages. In FANDANGO, constraints can use the whole Python language and library. This expressiveness gives testers unprecedented flexibility in shaping test inputs. It allows them to state arbitrary goals for test generation: "Please produce 1,000 valid test inputs where the <voltage> field follows a Gaussian distribution but never exceeds 20 mV."

FANDANGO: Evolving Language-Based Testing José Antonio Zamudio Amaya, Marius Smytzek, Andreas Zeller Language-based fuzzers leverage formal input specifications (languages) to generate arbitrarily large and diverse sets of valid inputs for a program under test. Modern language-based test generators combine grammars and constraints to satisfy syntactic and semantic input constraints. ISLa, the leading input generator in that space, uses symbolic constraint solving to solve input constraints. Using solvers places ISLa among the most precise fuzzers but also makes it slow. In this paper, we explore search-based testing as an alternative to symbolic constraint solving. We employ a genetic algorithm that iteratively generates candidate inputs from an input specification, evaluates them against defined constraints, evolving a population of inputs through syntactically valid mutations and retaining those with superior fitness until the semantic input constraints are met. This evolutionary procedure, analogous to natural genetic evolution, leads to progressively improved inputs that cover both semantics and syntax. This change boosts the efficiency of language-based testing: In our experiments, compared to ISLa, our search-based FANDANGO prototype is faster by one to three orders of magnitude without sacrificing precision. The search-based approach no longer restricts constraints to constraint solvers' (miniature) languages. In FANDANGO, constraints can use the whole Python language and library. This expressiveness gives testers unprecedented flexibility in shaping test inputs. It allows them to state arbitrary goals for test generation: "Please produce 1,000 valid test inputs where the <voltage> field follows a Gaussian distribution but never exceeds 20 mV."

What do you get if you combine #grammars, #constraints, #evolutionary algorithms, and #Python in one? A mighty fuzzer! Check out our latest #FANDANGO work, to appear at #ISSTA2025: publications.cispa.de/articles/sta... To try out Fandango yourself, check out its home page: fandango-fuzzer.github.io

24 4 0 1
Post image

#scribaland AN ANGEL OF NORWAY
When the great wind came from Oslo breathes on you,it so devastates everything in its path! Alas! #scribaland1 #angel #norway #anangelofnorway #instagrammers #internet #galeries #game #games #gaming #genius #grammar #grammars #instagrammer #interview #interviews #haiku

1 0 0 0
Post image

#scribaland LOVE SONG
A token of love! A love song for every occasion, a #chainlink! #scribaland1 #love #song #lovesong #faculties #galerie #galeries #game #games #gaming #genius #grammar #grammars #grammatical #google #googleadvertising #googleadwords #googlebook #googlebooks #googlekindle #writers

0 0 0 0
Post image

#scribaland FIRST LOVE IS A FOREVER MIRACLE
The most unforgettable? #scribaland1 #festivals #fiction #facts #faculty #faculties #galerie #galeries #game #games #gaming #genius #grammar #grammars #grammatical #google #googleadvertising #googleadwords #googlebook #googlebooks #googlekindle #googleplay

0 0 0 0
Post image

#scribaland LOVE TRAGEDY
#astorytelling, #ascarytale? #scribaland1 #love #tragedy #lovetragedy #faculty #faculties #galerie #contact #galeries #game #games #gaming #genius #grammar #grammars #grammatical #google #googleadvertising #googleadwords #googlebook #googlebooks #googlekindle #googleplay #ai

0 0 0 0
Post image

#scribaland LOVE TRAGEDY
A story telling, a scary tale? #scribaland1 #love #tragedy #lovetragedy #faculty #faculties #galerie #contact #galeries #game #games #gaming #genius #grammar #grammars #grammatical #google #googleadvertising #googleadwords #youscribe #audible #poems #poets #art #haiku #words

2 0 0 0
Post image

#scribaland BROTHERLY LOVE
From #kids to #adults: war for #toys, the parents’ affection and attention,and so much more…! #scribaland1 #brotherly #love #brotherlylove #exlibris #ereader #ereaders #ereading #facebook #faculty #grammars #dailypoems #dailypoetries #dailypoetry #dailypost #dailyposts #ai

0 0 0 0
Post image

#scribaland RECOVER FROM TOXIC FAMILY
Toxic childhood! Toxic parenthood! Unloving things in the name of love? #scribaland1 #recover #toxic #family #toxicfamily #recoverfromtoxicfamily #genius #grammar #grammars #grammatical #google #googleadvertising #googleadwords #googlebook #nftcollector #lecture

0 0 0 0

There ARE...not There IS.... #grammars
Ugh!

0 0 0 0
Post image

#scribaland KUNG FU GENERATION
Kung-Fu #fighter? Kung-Fu fighting? Like the #bigboss, the #master? Only one-inch punch! #scribaland1 #kungfu #generation #kungfugeneration #films #flickr #forum #forums #fact #facts #faculty #faculties #galerie #galeries #game #games #gaming #genius #grammar #grammars

0 0 0 0
Post image

#scribaland HUMAN COMPLEXITY
Humans are complex! #scribaland1 #human #complexity #humancomplexity #galerie #galeries #games #gaming #genius #grammar #grammars #grammatical #google #googleadvertising #googleadwords #googlebook #googlebooks #googlekindle #googleplay #haiku #hbomax #instagram #lectures

0 0 0 0
Post image

#scribaland FAME’S COST
Are you ready to pay the bill, and still pursue it at any cost? #scribaland1 #fame #cost #famescost #grammar #grammars #grammatical #google #googleadvertising #googleadwords #googlebook #googlebooks #googlekindle #googleplay #haiku #hbomax #homograph #homographs #poems #poets

0 0 0 0
Post image

#scribaland FAME’S COST
Are you ready to pay the bill, and still pursue it at any cost? #scribaland1 #fame #cost #famescost #grammar #grammars #grammatical #google #googleadvertising #googleadwords #googlebook #googlebooks #googlekindle #googleplay #haiku #hbomax #homograph #homographs #poems #poets

0 0 0 0
Post image

#scribaland LA VIE A DÉSORMAIS UN GOÛT AMER
Pourtant, il ne faut pas se décourager! #scribaland1 #vie #gout #amer #goutamer #fact #facts #faculty #faculties #flickr #forum #forums #galerie #galeries #game #games #gaming #genius #grammar #grammars #grammatical #google #googleadvertising #word #kindle

0 0 0 0
Post image

#scribaland DON’T LEAVE ME ON VALENTINE’S DAY
Break up with someone on #valentinesday morning, the Day is already a mess! #scribaland1 #valentineday #fact #facts #faculty #faculties #galerie #galeries #game #games #gaming #genius #grammar #grammars #grammatical #google #googleadwords #googlebook #ai

1 0 0 0
Post image

#scribaland COPYCAT WOMEN
#whysommewomencopythewomentheyhate? #scribaland1 #copycat #women #fact #facts #faculty #faculties #galerie #galeries #game #games #gaming #genius #grammar #grammars #grammatical #google #googleadvertising #googleadwords #googlebook #googlebooks #googlekindle #googleplay #ai

0 0 0 0
Post image

#scribaland DEMONIZING SOMEONE
Deifying someone and demonizing another one! #scribaland1 #demonizing #someone #demonizingsomeone #films #flickr #forum #forums #fact #facts #galery #galeries #game #games #gaming #genius #grammar #grammars #grammatical #google #googleadvertising #googleadwords #writer

2 0 0 0
Post image

#scribaland CHAMELEON EFFECT
Adopted! #scribaland1 #chameleon #effect #chameleoneffect #forum #forums #fact #facts #faculty #faculties #galerie #galeries #game #games #gaming #genius #grammar #grammars #grammatical #google #googleadvertising #googleadwords #figures #film #films #flickr #figure #lire

2 0 0 0
Post image

#scribaland MIDAS TOUCH
Do you have it, the #golden one, not the #sadim touch? #scribaland1 #midas #touch #midastouch #sadimtouch #gaming #genius #grammar #grammars #grammatical #google #googleadvertising #googleadwords #googlebook #googlebooks #googlekindle #googleplay #guide #guides #poetess #word

0 0 0 0
Post image

#scribaland SPREAD LOVE
Humans need tokens of love! Those #pledges of love #feed their minds! #scribaland1 #spread #love #fact #facts #faculty #faculties #galerie #galeries #game #games #gaming #genius #grammar #grammars #grammatical #google #googleadvertising #googleadwords #googlebook #googlebooks

1 0 0 0
Post image

#scribaland SOLDIERS ANGELS
The only weapon,the greatest one is love! It takes much #courage to be an angel,a #goldensoldier! #scribaland1 #soldiers #angels #soldiersangels #genius #grammar #grammars #grammatical #google #googleadvertising #googleadwords #googlebook #googlebooks #googlekindle #haiku

2 0 0 0
Post image

#scribaland QUEEN OF THE GLACIERS
The Beloved,surrounded by armed #elves and #goblins, was thrown into the #ravine! He bowed with the all- #chivalrous appearance! #scribaland1 #queen #glaciers #queenoftheglaciers #beloved #grammar #grammars #grammatical #google #googleadvertising #googleadwords #nft

1 0 0 0