Hi All,

I am receiving a flat file and need to convert it from non unicode to unicode based on some conditions.

Below is the code for conversion , in the pipeline but its not working. Any suggestions ?

            MemoryStream mem = new MemoryStream();
            byte[] outBytes2 = System.Text.Encoding.GetEncoding("UTF-8").GetBytes(content);
            MemoryStream memStream2 = new MemoryStream();
            memStream2.Write(outBytes2, 0, outBytes2.Length);
            memStream2.Position = 0;
            pInMsg.BodyPart.Data = memStream2;

            return pInMsg

Hi Varun,

Can you please refer

http://winterdom.com/2006/01/fixmessageencodingcustompipelinecomponentsample

http://stackoverflow.com/questions/7529143/is-there-any-way-to-change-encoding-in-a-receive-pipeline-in-biztalk

Thanks

Abhishek

I don't think a Custom Pipeline Component is required here.

Simply set the Code Page Property in your Flat File Schema to the non-unicode encoding the document is delivered as (ASCII 20127, Western-European 1252, etc.). That way the Flat File Disassembler will automatically convert from your non-unicode code page to UTF-8.

Morten la Cour

Thanks for you reply Morten,

I dont have any schema because no need to perform any data operation.

Hi Varun,

Please try below code,

MemoryStream mem = new MemoryStream();
byte[] outBytes2 = System.Text.Encoding.GetEncoding("UTF-8").GetBytes(content);
mem.Write(outBytes2, 0, outBytes2.Length);
mem.Seek(0,SeekOrigin.Begin);
pInMsg.BodyPart.Data = mem;

Hold on...there's a bit more to this.

Do you know exactly what encoding/code page the source is coming in?

Why do you need to 'convert' it?

What about the BOM?

Hi Varun,

Try the below code it should work.

If not please post similar sample text contain the characters that your are facing.

byte[] bytesString = Encoding.UTF8.GetBytes(xmlDocument);
MemoryStream OutmemoryStream = new MemoryStream();
OutmemoryStream.Write(bytesString, 0, bytesString.Length);
OutmemoryStream.Seek(0, SeekOrigin.Begin);
pInMsg.BodyPart.Data = OutmemoryStream;
pContext.ResourceTracker.AddResource(OutmemoryStream);
return pInMsg;

Thanks, SMSVikasK

Hi Varun,

Try the below code it should work.

If not please post similar sample text contain the characters that your are facing.

byte[] bytesString = Encoding.UTF8.GetBytes(xmlDocument);
MemoryStream OutmemoryStream = new MemoryStream();
OutmemoryStream.Write(bytesString, 0, bytesString.Length);
OutmemoryStream.Seek(0, SeekOrigin.Begin);
pInMsg.BodyPart.Data = OutmemoryStream;
pContext.ResourceTracker.AddResource(OutmemoryStream);
return pInMsg;

Thanks, SMSVikasK

• Proposed as answer by SMSVikasK 9 hours 47 minutes ago

Hi Varun,

Try the below code it should work.

If not please post similar sample text contain the characters that your are facing.

byte[] bytesString = Encoding.UTF8.GetBytes(xmlDocument);
MemoryStream OutmemoryStream = new MemoryStream();
OutmemoryStream.Write(bytesString, 0, bytesString.Length);
OutmemoryStream.Seek(0, SeekOrigin.Begin);
pInMsg.BodyPart.Data = OutmemoryStream;
pContext.ResourceTracker.AddResource(OutmemoryStream);
return pInMsg;

Thanks, SMSVikasK

• Proposed as answer by SMSVikasK Tuesday, September 01, 2015 9:20 PM

Hi Varun,

Try the below code it should work.

If not please post similar sample text contain the characters that your are facing.

byte[] bytesString = Encoding.UTF8.GetBytes(xmlDocument);
MemoryStream OutmemoryStream = new MemoryStream();
OutmemoryStream.Write(bytesString, 0, bytesString.Length);
OutmemoryStream.Seek(0, SeekOrigin.Begin);
pInMsg.BodyPart.Data = OutmemoryStream;
pContext.ResourceTracker.AddResource(OutmemoryStream);
return pInMsg;

Thanks, SMSVikasK

• Proposed as answer by SMSVikasK Tuesday, September 01, 2015 9:20 PM
• Marked as answer by Angie xuMicrosoft contingent staff, Moderator 5 hours 22 minutes ago