non-text input?

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

non-text input?

lee mighdoll
Parboiled is nifty!  Is it feasible to use parboiled to parse non text input streams?  

I'd like to parse a sequence of captured network packets to look for patterns.  I'm happy to express the packets in any convenient form in scala.  

I suppose I could convert them to strings, but that seems a bit awkward.

 
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: non-text input?

mathias
Administrator
Lee,

unfortunately parboiled doesn't support binary input so far.

However, there is currently an application for a "parboiled 2" GSoC project in the making, which I would be mentoring in the coming weeks/months.
The goal of this project is a pure-scala rewrite with a much improved architecture which also supports grammars for non-text input.
Contrary to parboiled 1.x, which "interprets" a rule structure (that is built via the DSL) against an input buffer, the next version will use the DSL to generate the parser logic *at compile time* (via Scala 2.10 macros). This will result in a significant performance improvement (parboiled parser will be roughly as fast as well-done hand-written ones).
Additionally all kinds of other improvements will make their way into the code (for example even more flexibility in type-safe rule composition as well as "continuation parsing", where the parser can automatically save its current state at the end of the input in order to continue parsing once more data become available, which is often helpful in packet-based network communication).

If this GSoC application gets accepted we'll have a pretty clear timeline as to when parboiled 2 will be available.
If not parboiled 2 will still come, but it might take a bit longer…

Cheers,
Mathias

---
[hidden email]
http://www.parboiled.org

On 02.05.2013, at 07:09, lee mighdoll [via parboiled users] <[hidden email]> wrote:

>
>
> Parboiled is nifty!  Is it feasible to use parboiled to parse non text input
> streams?  
>
> I'd like to parse a sequence of captured network packets to look for
> patterns.  I'm happy to express the packets in any convenient form in scala.  
>
> I suppose I could convert them to strings, but that seems a bit awkward.
>
>
>
>
>
> _______________________________________________
> If you reply to this email, your message will be added to the discussion below:
> http://users.parboiled.org/non-text-input-tp4024184.html
> To start a new topic under parboiled users, email [hidden email]
> To unsubscribe from parboiled users, visit
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: non-text input?

lee mighdoll
That sounds great,

I'll continue to enjoy parboiled 1 for text input for now, and look forward to parboiled 2.

Cheers,
Lee


On Thu, May 2, 2013 at 2:59 AM, mathias [via parboiled users] <[hidden email]> wrote:
Lee,

unfortunately parboiled doesn't support binary input so far.

However, there is currently an application for a "parboiled 2" GSoC project in the making, which I would be mentoring in the coming weeks/months.
The goal of this project is a pure-scala rewrite with a much improved architecture which also supports grammars for non-text input.
Contrary to parboiled 1.x, which "interprets" a rule structure (that is built via the DSL) against an input buffer, the next version will use the DSL to generate the parser logic *at compile time* (via Scala 2.10 macros). This will result in a significant performance improvement (parboiled parser will be roughly as fast as well-done hand-written ones).
Additionally all kinds of other improvements will make their way into the code (for example even more flexibility in type-safe rule composition as well as "continuation parsing", where the parser can automatically save its current state at the end of the input in order to continue parsing once more data become available, which is often helpful in packet-based network communication).

If this GSoC application gets accepted we'll have a pretty clear timeline as to when parboiled 2 will be available.
If not parboiled 2 will still come, but it might take a bit longer…

Cheers,
Mathias

---
[hidden email]
http://www.parboiled.org

On 02.05.2013, at 07:09, lee mighdoll [via parboiled users] <[hidden email]> wrote:

>
>
> Parboiled is nifty!  Is it feasible to use parboiled to parse non text input
> streams?  
>
> I'd like to parse a sequence of captured network packets to look for
> patterns.  I'm happy to express the packets in any convenient form in scala.  
>
> I suppose I could convert them to strings, but that seems a bit awkward.
>
>
>
>
>
> _______________________________________________
> If you reply to this email, your message will be added to the discussion below:
> http://users.parboiled.org/non-text-input-tp4024184.html
> To start a new topic under parboiled users, email [hidden email]
> To unsubscribe from parboiled users, visit


To unsubscribe from non-text input?, click here.
NAML

Loading...