Unlawful use of Unicode characters

I am currently experiencing an issue while attempting to upload the document.sdf (json) file to Amazon Cloud Search. Everything works seamlessly until certain special characters are encountered.

Encountered Unicode characters that are not compliant with Cloud Search standards:\n Illegal Unicode character '\u0002'\n Illegal Unicode character '\u0010'\n Illegal Unicode character '\u0001'\n Illegal Unicode character '\b'

The error arises from the following snippet of text:

...sadad<br \/>\n;color:G\u0002% k\u0010>\u0001\b? X_? p>", ...

These errors stem from the document.sdf file, which is generated by a PHP script and then encoded in JSON format using json_encode()

This is the original text mentioned above:

;color:G% k>? X_? p>

phpjsonunicodeamazon-web-servicesamazon-cloudsearch

Answer №1

To ensure text cleanliness, consider using a regex to remove any invalid characters from the data:

[^\u0009\u000A\u000D\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]

In a similar situation I faced, the issue was resolved by explicitly setting the character encoding during the POST request, as shown below:

$curl = curl_init($cloudsearch_url);
curl_setopt($curl, CURLOPT_HTTPHEADER, 
            array('Content-Type: application/json; charset=UTF-8')); //Ensures correct character encoding
curl_setopt($curl, CURLOPT_POST, true);
curl_setopt($curl, CURLOPT_POSTFIELDS, $post_data);
curl_exec($curl);

Similar questions

If you have not found the answer to your question or you are interested in this topic, then look at other similar questions below or use the search

AngularJS - Managing Multiple State Parameters

Currently, we are in the process of learning AngularJS and are facing difficulty with a specific issue. We aim to select a product type and utilize the formData value ("productType":"1") image1 to accurately display the JSON product data associated with th ...

jsonangularjsapi

Improving user experience with CodeIgniter's form validation powered by AJAX and jQuery

I am currently attempting to validate certain fields using AJAX in CodeIgniter, but I'm having some difficulty getting it to work correctly. This is the AJAX code snippet that I have: var timeout = null; $(document).ready(function(){ $('. ...

phpjqueryajaxcodeigniter

Having difficulty enabling mod_rewrite for URLs in XAMPP on Windows 8

Despite numerous attempts to configure URL rewriting, I have been unsuccessful. After extensive Google searches and trying various codes found on Stack Overflow, none of them seem to work for me. At this point, I am compelled to seek assistance. I aspire ...

phpapachephp-7

Establishing a Secure Connection between PHP Server and Amazon AWS MySQL Server

Currently, I have set up two servers on Amazon AWS. One server is dedicated to running PHP while the other handles MySQL. Accessing the MySQL database through my terminal and MySQL Query Browser has proven successful. However, I am facing challenges in es ...

phpmysqlamazon-web-servicesconnectioninternal

Use PHP snippets within your WordPress pages to display posts from a specific category

I'm a newcomer to Wordpress and I need help with organizing my posts. I have two pages on my website, 'Newsletters' and 'Service News', where I want to display posts based on specific categories. For 'Newsletters', I want ...

phpwordpressposts

Unraveling a PDF string and transmitting it through CodeIgniter's email feature

For the past couple of days, I've been trying to use dompdf to generate a PDF. My process involves taking the raw string, encoding it for later database storage, and then decoding it so that I can send it as an attachment via email. However, despite m ...

phpcodeigniteremailpdfdompdf

Providing input through the URL bar in PHP and HTML

I have a simple form on my website's HTML page. <form action="post.php" method="post"> Message: <input type="text" name="message" /> &nbsp; <input type="submit" name="submit" value="send"> </form> After submitti ...

phphtml

Tips for obtaining user Seller ID, Marketplace ID, and MWS token?

I need assistance with Amazon API's as I work on developing a web application. My goal is to gather the user's Seller ID, Marketplace ID, and MWS token when they register on my platform. During the registration process, users will be redirected t ...

phpamazon-web-servicespayment-gatewayamazon-mws

I would like to create a map showing the selected locations by checking them off using checkboxes

How can I draw a road map by selecting locations with checkboxes in form.php? After posting the selected locations to map.php file and assigning them to a $location array, how do I then assign these values to the waypoints array in the javascript calcRoute ...

javascriptphp

How to choose the option in one select box based on the selection in another, and vice versa

How can I dynamically select options in one select box based on the selection of another, and vice versa? I am using Ajax to redirect to a query page. while($result = mysql_fetch_assoc($query1)) { echo "<option value=".$result['username' ...

javascriptphpjqueryajax

Show a variety of pictures in a random arrangement?

Looking for some help here! I'm trying to shuffle my images in a random order each time the page is refreshed. It's like a game of musical chairs but with pictures! Does anyone know how to achieve this? I've done some searching, but haven& ...

javascriptphphtml

Using regular expressions to capture a section of text enclosed by specific patterns

Hey there! I'm facing a challenge with my PHP script. I'm working on parsing our workorder system to retrieve a set of tickets, but I've hit a bit of roadblock when it comes to parsing the ticket list. I've been trying to rely on regex ...

phpregex

The autocomplete feature is working, but it seems to be unable to locate any words

I have encountered an issue with the autocomplete feature, where words starting with an Uppercase letter are not being recognized properly. For example, 'Brussels': I can find it by typing in 'russels' in the searchbox, but 'Bru. ...

phpjquerymysqluppercase

Allow the json array to be transformed into a format suitable for input

Hey there, I've received a JSON array as the response of my ajax request: {"chart":{"2016-03-08":"1","2016-03-07":"4","2016-03-06":0,"2016-03-05" :0,"2016-03-04":0,"2016-03-03":"145","2016-03-02":0}} Now, I'm looking to create a chart using the ...

javascriptjqueryarraysjsoncharts

Leveraging Angular for Parsing JSON Data

I have a JSON object that I want to use in my code. The goal is to assign the values of certain properties from the JSON object to four variables in my Angular project. These variables are named as follows: authorText : string; titleText : string; duratio ...

jsonangular

Change JSON data into a text format

Looking for help with a Java issue I'm having. Despite reading tutorials and asking questions, I'm still struggling to apply the knowledge to solve my problem. Here's the issue: I need to read multiple json files in one place and convert t ...

javajsonparsing

Having Trouble Receiving Desired Results with Ajax and JSONP

Testing jsonp for a new project. The html page features ajax, displaying a drop-down form and an empty table. The table cells will be populated based on the jsonp response fetched by ajax. The php response is hosted separately but doesn't seem to wo ...

phpjqueryhtmlajaxjson

Having trouble loading JSON in Python line by line?

Presented here is the format of my JSON file: [{ "name": "", "official_name_en": "Channel Islands", "official_name_fr": "Îles Anglo-Normandes", }, and so forth...... Upon attempting to load the aforementioned JSON file, I encountered this error: json.d ...

pythonjson

Use AJAX to send a form submission along with an anchor tag

I've been facing a challenge trying to make this work, but unfortunately, I haven't had any success. Typically, all my forms include a submit input, and I handle AJAX submission in the following manner: <script> $("input#submit").click(fun ...

javascriptphpjqueryajaxforms

PHP - Monitoring for File Existence

I'm trying to execute an exe file that generates txt files and then check if those txt files have been created. When I use xampp, I've tried dragging a test.txt file into the php scripts directory, but it doesn't work correctly. Also, if I ...

phpwhile-loopwait