Ttykuu

Why is "Reports" in the sentence below without the article "The"?

Wild Shape Centaur Into a Giant Elk: do their Charges stack?

Symmetry in quantum mechanics

Process builder are scheduled actions independent?

Least quadratic residue under GRH: an explicit bound

Latin words with no plurals in English

How to handle columns with categorical data and many unique values

Could a US political party gain complete control over the government by removing checks & balances?

Extreme, but not acceptable situation and I can't start the work tomorrow morning

How to deal with fear of taking dependencies

What do you call something that goes against the spirit of the law, but is legal when interpreting the law to the letter?

Some basic questions on halt and move in Turing machines

Sort in WP_Query(), not filter? Is it possible?

How do you conduct xenoanthropology after first contact?

Denied boarding due to overcrowding, Sparpreis ticket. What are my rights?

cryptic clue: mammal sounds like relative consumer (8)

How to answer pointed "are you quitting" questioning when I don't want them to suspect

Why do UK politicians seemingly ignore opinion polls on Brexit?

What kind of transistor turns on with 0.2 volts?

Can you lasso down a wizard who is using the Levitate spell?

Is there a familial term for apples and pears?

DOS, create pipe for stdin/stdout of command.com(or 4dos.com) in C or Batch?

Is domain driven design an anti-SQL pattern?

A newer friend of my brother's gave him a load of baseball cards that are supposedly extremely valuable. Is this a scam?

StringReader reuse for XML Parsing in C#

XML schema parsing and XML creation from flat filesParsing XML in PythonXmlCmdBuilder - doing away with inline xmlObject to object mapping verification - is this extension method useful?XML parsing in Java using SAX parserXML/HTML Read/WriteGeneric methods for serializing and deserialzing xml files using streamsParse child value from XML using ezxmlAnalyze Shakespeare's Macbeth parsing XML from web using NokogiriParsing XML documents with LXML

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;

0

$begingroup$

I'm developing a generic XML Parser that would parse chunks of a given XML to a given list of types by using the "Pull parsing" approach, which I think is more "memory efficient/predictable", instead of loading unknown-sized XML files into memory.

I'm caching the XmlSerializer objects for the given types and the last bit that I'm concerned is the following:

The Deserialize method from XmlSerializer expects a Stream. To accomplish that, for each object that matches the criteria, I'm creating a new StringReader.

My concern is: If I parse an arbitrarily big XML file, for each object that meets the criteria I'll be creating a new StringReader object. This is a "short-lived" object and for sure I'll get lots of GC calls to deal with dangling StringReader objects, which I guess that may be harmful, performance-wise.

I have the following questions:

• Is there a way to recycle/reuse a StringReader to reduce the number of GC calls?


• Is this way of parsing scalable?

My current code looks like this:

public IColletion<object> RetrieveObjectsFromXml(
 Stream stream,
 XmlSchemaSet schemaSet,
 params Type[] types)

 var result = new List<object>();

 // validations and other operations here...

 using (var reader = XmlReader.Create(stream, readerSettings))
 
 while (reader.Read())
 
 if (reader.NodeType != XmlNodeType.Element)
 
 continue;
 

 // using HashSet, so this check will be O(1)
 if (TagNameWillBeRetrieved(reader.SchemaInfo.SchemaElement.Name))
 
 var data = reader.ReadOuterXml();

 using (var stringReader = new StringReader(data))
 
 // this method returns a XmlSerializer for a type
 // which this tag belongs to.
 var obj = GetXmlSerializerForTag(
 reader.SchemaInfo.SchemaElement.Name)
 .Deserialize(stringReader);

 // this is just for brevity. I'll be yielding results here,
 // yielding events or something else
 // instead of returning a list of objects :)

 result.Add(obj);
 
 
 
 
 return result;

c# memory-management xml

share

asked 4 mins ago

cezarlamanncezarlamann

1011

New contributor

cezarlamann is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

$endgroup$

add a comment | 

0

$begingroup$

I'm developing a generic XML Parser that would parse chunks of a given XML to a given list of types by using the "Pull parsing" approach, which I think is more "memory efficient/predictable", instead of loading unknown-sized XML files into memory.

I'm caching the XmlSerializer objects for the given types and the last bit that I'm concerned is the following:

The Deserialize method from XmlSerializer expects a Stream. To accomplish that, for each object that matches the criteria, I'm creating a new StringReader.

My concern is: If I parse an arbitrarily big XML file, for each object that meets the criteria I'll be creating a new StringReader object. This is a "short-lived" object and for sure I'll get lots of GC calls to deal with dangling StringReader objects, which I guess that may be harmful, performance-wise.

I have the following questions:

• Is there a way to recycle/reuse a StringReader to reduce the number of GC calls?


• Is this way of parsing scalable?

My current code looks like this:

public IColletion<object> RetrieveObjectsFromXml(
 Stream stream,
 XmlSchemaSet schemaSet,
 params Type[] types)

 var result = new List<object>();

 // validations and other operations here...

 using (var reader = XmlReader.Create(stream, readerSettings))
 
 while (reader.Read())
 
 if (reader.NodeType != XmlNodeType.Element)
 
 continue;
 

 // using HashSet, so this check will be O(1)
 if (TagNameWillBeRetrieved(reader.SchemaInfo.SchemaElement.Name))
 
 var data = reader.ReadOuterXml();

 using (var stringReader = new StringReader(data))
 
 // this method returns a XmlSerializer for a type
 // which this tag belongs to.
 var obj = GetXmlSerializerForTag(
 reader.SchemaInfo.SchemaElement.Name)
 .Deserialize(stringReader);

 // this is just for brevity. I'll be yielding results here,
 // yielding events or something else
 // instead of returning a list of objects :)

 result.Add(obj);
 
 
 
 
 return result;

c# memory-management xml

share

asked 4 mins ago

cezarlamanncezarlamann

1011

New contributor

cezarlamann is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

$endgroup$

add a comment | 

$begingroup$

I'm developing a generic XML Parser that would parse chunks of a given XML to a given list of types by using the "Pull parsing" approach, which I think is more "memory efficient/predictable", instead of loading unknown-sized XML files into memory.

I'm caching the XmlSerializer objects for the given types and the last bit that I'm concerned is the following:

The Deserialize method from XmlSerializer expects a Stream. To accomplish that, for each object that matches the criteria, I'm creating a new StringReader.

My concern is: If I parse an arbitrarily big XML file, for each object that meets the criteria I'll be creating a new StringReader object. This is a "short-lived" object and for sure I'll get lots of GC calls to deal with dangling StringReader objects, which I guess that may be harmful, performance-wise.

I have the following questions:

• Is there a way to recycle/reuse a StringReader to reduce the number of GC calls?


• Is this way of parsing scalable?

My current code looks like this:

public IColletion<object> RetrieveObjectsFromXml(
 Stream stream,
 XmlSchemaSet schemaSet,
 params Type[] types)

 var result = new List<object>();

 // validations and other operations here...

 using (var reader = XmlReader.Create(stream, readerSettings))
 
 while (reader.Read())
 
 if (reader.NodeType != XmlNodeType.Element)
 
 continue;
 

 // using HashSet, so this check will be O(1)
 if (TagNameWillBeRetrieved(reader.SchemaInfo.SchemaElement.Name))
 
 var data = reader.ReadOuterXml();

 using (var stringReader = new StringReader(data))
 
 // this method returns a XmlSerializer for a type
 // which this tag belongs to.
 var obj = GetXmlSerializerForTag(
 reader.SchemaInfo.SchemaElement.Name)
 .Deserialize(stringReader);

 // this is just for brevity. I'll be yielding results here,
 // yielding events or something else
 // instead of returning a list of objects :)

 result.Add(obj);
 
 
 
 
 return result;

c# memory-management xml

share

asked 4 mins ago

cezarlamanncezarlamann

1011

New contributor

cezarlamann is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

$endgroup$

public IColletion<object> RetrieveObjectsFromXml(
 Stream stream,
 XmlSchemaSet schemaSet,
 params Type[] types)

 var result = new List<object>();

 // validations and other operations here...

 using (var reader = XmlReader.Create(stream, readerSettings))
 
 while (reader.Read())
 
 if (reader.NodeType != XmlNodeType.Element)
 
 continue;
 

 // using HashSet, so this check will be O(1)
 if (TagNameWillBeRetrieved(reader.SchemaInfo.SchemaElement.Name))
 
 var data = reader.ReadOuterXml();

 using (var stringReader = new StringReader(data))
 
 // this method returns a XmlSerializer for a type
 // which this tag belongs to.
 var obj = GetXmlSerializerForTag(
 reader.SchemaInfo.SchemaElement.Name)
 .Deserialize(stringReader);

 // this is just for brevity. I'll be yielding results here,
 // yielding events or something else
 // instead of returning a list of objects :)

 result.Add(obj);
 
 
 
 
 return result;

share

asked 4 mins ago

cezarlamanncezarlamann

1011

New contributor

cezarlamann is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

share

asked 4 mins ago

cezarlamanncezarlamann

1011

New contributor

cezarlamann is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

asked 4 mins ago

cezarlamanncezarlamann

1011

New contributor

cezarlamann is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

asked 4 mins ago

cezarlamanncezarlamann

1011