New line as whitespace and terminator











up vote
1
down vote

favorite












I am parsing javascript ES6, however I can't get it to work without semicolons. I used Tin's grammar from ES5 as base , ( https://github.com/usethesource/rascal/blob/master/src/org/rascalmpl/library/lang/javascript/saner/Syntax.rsc ) and already got most of the new features from ES6, but I still can't remove the need for semicolons



Take for example:



lexical Whitespace
= [t-nr ];

lexical LAYOUT
= Whitespace
| Comment
;

layout LAYOUTLIST
= LAYOUT*
!>> [t n]
!>> "/*"
!>> "//" ;


syntax Variable
= VariableIdentifier {VariableDeclaration ","}+ declarations ";"

syntax Statement
= varDecl: Variable varDecl;


I get parsing error replacing ";" to "n" on Syntax Variable , or even creating a new rule for end of statement:



syntax EOS
= ";" | "n";


The parsing error goes to the next line after the newline.



Removing from whitespaces or from the layoutlist gives me parsing error on comments at the start of the file.



And removing on the layoutlist gives me ambiguity.










share|improve this question






















  • This is tricky stuff! You need a number of advanced features and a lot of thinking and debugging you get this right. I'll try and list the useful features in an answer tomorrow if I feel well enough. For now it's best to go for an ambiguous grammar first, which exactly describes js syntax input but is an over-approximation (too many) for its syntax trees. Using step-by-step grammar changes, and adding disambiguation constructs you can filter the superfluous trees. Better make a regression test set using rascals test function feature as well, to help in trusting the changes.
    – jurgenv
    2 days ago















up vote
1
down vote

favorite












I am parsing javascript ES6, however I can't get it to work without semicolons. I used Tin's grammar from ES5 as base , ( https://github.com/usethesource/rascal/blob/master/src/org/rascalmpl/library/lang/javascript/saner/Syntax.rsc ) and already got most of the new features from ES6, but I still can't remove the need for semicolons



Take for example:



lexical Whitespace
= [t-nr ];

lexical LAYOUT
= Whitespace
| Comment
;

layout LAYOUTLIST
= LAYOUT*
!>> [t n]
!>> "/*"
!>> "//" ;


syntax Variable
= VariableIdentifier {VariableDeclaration ","}+ declarations ";"

syntax Statement
= varDecl: Variable varDecl;


I get parsing error replacing ";" to "n" on Syntax Variable , or even creating a new rule for end of statement:



syntax EOS
= ";" | "n";


The parsing error goes to the next line after the newline.



Removing from whitespaces or from the layoutlist gives me parsing error on comments at the start of the file.



And removing on the layoutlist gives me ambiguity.










share|improve this question






















  • This is tricky stuff! You need a number of advanced features and a lot of thinking and debugging you get this right. I'll try and list the useful features in an answer tomorrow if I feel well enough. For now it's best to go for an ambiguous grammar first, which exactly describes js syntax input but is an over-approximation (too many) for its syntax trees. Using step-by-step grammar changes, and adding disambiguation constructs you can filter the superfluous trees. Better make a regression test set using rascals test function feature as well, to help in trusting the changes.
    – jurgenv
    2 days ago













up vote
1
down vote

favorite









up vote
1
down vote

favorite











I am parsing javascript ES6, however I can't get it to work without semicolons. I used Tin's grammar from ES5 as base , ( https://github.com/usethesource/rascal/blob/master/src/org/rascalmpl/library/lang/javascript/saner/Syntax.rsc ) and already got most of the new features from ES6, but I still can't remove the need for semicolons



Take for example:



lexical Whitespace
= [t-nr ];

lexical LAYOUT
= Whitespace
| Comment
;

layout LAYOUTLIST
= LAYOUT*
!>> [t n]
!>> "/*"
!>> "//" ;


syntax Variable
= VariableIdentifier {VariableDeclaration ","}+ declarations ";"

syntax Statement
= varDecl: Variable varDecl;


I get parsing error replacing ";" to "n" on Syntax Variable , or even creating a new rule for end of statement:



syntax EOS
= ";" | "n";


The parsing error goes to the next line after the newline.



Removing from whitespaces or from the layoutlist gives me parsing error on comments at the start of the file.



And removing on the layoutlist gives me ambiguity.










share|improve this question













I am parsing javascript ES6, however I can't get it to work without semicolons. I used Tin's grammar from ES5 as base , ( https://github.com/usethesource/rascal/blob/master/src/org/rascalmpl/library/lang/javascript/saner/Syntax.rsc ) and already got most of the new features from ES6, but I still can't remove the need for semicolons



Take for example:



lexical Whitespace
= [t-nr ];

lexical LAYOUT
= Whitespace
| Comment
;

layout LAYOUTLIST
= LAYOUT*
!>> [t n]
!>> "/*"
!>> "//" ;


syntax Variable
= VariableIdentifier {VariableDeclaration ","}+ declarations ";"

syntax Statement
= varDecl: Variable varDecl;


I get parsing error replacing ";" to "n" on Syntax Variable , or even creating a new rule for end of statement:



syntax EOS
= ";" | "n";


The parsing error goes to the next line after the newline.



Removing from whitespaces or from the layoutlist gives me parsing error on comments at the start of the file.



And removing on the layoutlist gives me ambiguity.







javascript grammar rascal






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked 2 days ago









Adriano Torres

133




133












  • This is tricky stuff! You need a number of advanced features and a lot of thinking and debugging you get this right. I'll try and list the useful features in an answer tomorrow if I feel well enough. For now it's best to go for an ambiguous grammar first, which exactly describes js syntax input but is an over-approximation (too many) for its syntax trees. Using step-by-step grammar changes, and adding disambiguation constructs you can filter the superfluous trees. Better make a regression test set using rascals test function feature as well, to help in trusting the changes.
    – jurgenv
    2 days ago


















  • This is tricky stuff! You need a number of advanced features and a lot of thinking and debugging you get this right. I'll try and list the useful features in an answer tomorrow if I feel well enough. For now it's best to go for an ambiguous grammar first, which exactly describes js syntax input but is an over-approximation (too many) for its syntax trees. Using step-by-step grammar changes, and adding disambiguation constructs you can filter the superfluous trees. Better make a regression test set using rascals test function feature as well, to help in trusting the changes.
    – jurgenv
    2 days ago
















This is tricky stuff! You need a number of advanced features and a lot of thinking and debugging you get this right. I'll try and list the useful features in an answer tomorrow if I feel well enough. For now it's best to go for an ambiguous grammar first, which exactly describes js syntax input but is an over-approximation (too many) for its syntax trees. Using step-by-step grammar changes, and adding disambiguation constructs you can filter the superfluous trees. Better make a regression test set using rascals test function feature as well, to help in trusting the changes.
– jurgenv
2 days ago




This is tricky stuff! You need a number of advanced features and a lot of thinking and debugging you get this right. I'll try and list the useful features in an answer tomorrow if I feel well enough. For now it's best to go for an ambiguous grammar first, which exactly describes js syntax input but is an over-approximation (too many) for its syntax trees. Using step-by-step grammar changes, and adding disambiguation constructs you can filter the superfluous trees. Better make a regression test set using rascals test function feature as well, to help in trusting the changes.
– jurgenv
2 days ago

















active

oldest

votes











Your Answer






StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














 

draft saved


draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53410259%2fnew-line-as-whitespace-and-terminator%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown






























active

oldest

votes













active

oldest

votes









active

oldest

votes






active

oldest

votes
















 

draft saved


draft discarded



















































 


draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53410259%2fnew-line-as-whitespace-and-terminator%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Contact image not getting when fetch all contact list from iPhone by CNContact

count number of partitions of a set with n elements into k subsets

A CLEAN and SIMPLE way to add appendices to Table of Contents and bookmarks