Why isn't Gson parsing my document with nested escaped JSON string? - java
I'm having an annoying problem with GSON.
I can't get this document to parse:
[{"id":0,"assetId":2414775,"shipId":717,"assetType":"0","document":"{\"ratios\":[{\"points\":{\"x1\":0,\"y1\":673,\"x2\":3744,\"y2\":4408},\"crop\":[{\"name\":\"1_1\",\"width\":3744,\"height\":3735,\"path\":\"1371046546001-RCI-Test-Seas-1306121019_1_1.jpg\"},{\"name\":\"x-supersquare\",\"width\":1024,\"height\":1024,\"path\":\"1371046546001-RCI-Test-Seas-1306121019_x-supersquare.jpg\"},{\"name\":\"x-square\",\"width\":98,\"height\":98,\"path\":\"1371046546001-RCI-Test-Seas-1306121019_x-square.jpg\"},{\"name\":\"x48\",\"width\":48,\"height\":48,\"path\":\"1371046546001-RCI-Test-Seas-1306121019_x48.jpg\"}],\"name\":\"1_1\",\"basename\":null,\"cropped\":true},{\"points\":{\"x1\":0,\"y1\":842,\"x2\":3744,\"y2\":3650},\"crop\":[{\"name\":\"4_3\",\"width\":3744,\"height\":2808,\"path\":\"1371046546001-RCI-Test-Seas-1306121019_4_3.jpg\"},{\"name\":\"x-superlarge\",\"width\":2048,\"height\":1536,\"path\":\"1371046546001-RCI-Test-Seas-1306121019_x-superlarge.jpg\"},{\"name\":\"x-extralarge\",\"width\":1024,\"height\":768,\"path\":\"1371046546001-RCI-Test-Seas-1306121019_x-extralarge.jpg\"},{\"name\":\"x-large\",\"width\":490,\"height\":368,\"path\":\"1371046546001-RCI-Test-Seas-1306121019_x-large.jpg\"},{\"name\":\"x\",\"width\":245,\"height\":184,\"path\":\"1371046546001-RCI-Test-Seas-1306121019_x.jpg\"},{\"name\":\"x86\",\"width\":115,\"height\":86,\"path\":\"1371046546001-RCI-Test-Seas-1306121019_x86.jpg\"}],\"name\":\"4_3\",\"basename\":null,\"cropped\":true},{\"points\":{\"x1\":0,\"y1\":322,\"x2\":3744,\"y2\":5307},\"crop\":[{\"name\":\"3_4\",\"width\":3744,\"height\":4985,\"path\":\"1371046546001-RCI-Test-Seas-1306121020_3_4.jpg\"},{\"name\":\"x-3-4\",\"width\":768,\"height\":1024,\"path\":\"1371046546001-RCI-Test-Seas-1306121020_x-3-4.jpg\"}],\"name\":\"3_4\",\"basename\":null,\"cropped\":true},{\"points\":{\"x1\":0,\"y1\":1755,\"x2\":3744,\"y2\":3861},\"crop\":[{\"name\":\"16_9\",\"width\":3744,\"height\":2106,\"path\":\"1371046546001-RCI-Test-Seas-1306121020_16_9.jpg\"},{\"name\":\"x-16-9super\",\"width\":2048,\"height\":1162,\"path\":\"1371046546001-RCI-Test-Seas-1306121020_x-16-9super.jpg\"},{\"name\":\"x-16-9\",\"width\":1280,\"height\":720,\"path\":\"1371046546001-RCI-Test-Seas-1306121020_x-16-9.jpg\"}],\"name\":\"16_9\",\"basename\":null,\"cropped\":true},{\"points\":{\"x1\":295,\"y1\":0,\"x2\":3448,\"y2\":5616},\"crop\":[{\"name\":\"9_16\",\"width\":3153,\"height\":5616,\"path\":\"1371046546001-RCI-Test-Seas-1306121020_9_16.jpg\"},{\"name\":\"x-9-16\",\"width\":720,\"height\":1280,\"path\":\"1371046546001-RCI-Test-Seas-1306121020_x-9-16.jpg\"}],\"name\":\"9_16\",\"basename\":null,\"cropped\":true},{\"points\":{\"x1\":0,\"y1\":1221,\"x2\":3744,\"y2\":4408},\"crop\":[{\"name\":\"front_thumb\",\"width\":3744,\"height\":3187,\"path\":\"1371046546001-RCI-Test-Seas-1306121021_front_thumb.jpg\"},{\"name\":\"x-front-thumb\",\"width\":115,\"height\":98,\"path\":\"1371046546001-RCI-Test-Seas-1306121021_x-front-thumb.jpg\"}],\"name\":\"front_thumb\",\"basename\":null,\"cropped\":true}],\"attributes\":[{\"name\":\"oImageHeight\",\"value\":\"5616\"},{\"name\":\"oImageWidth\",\"value\":\"3744\"},{\"name\":\"sImageHeight\",\"value\":\"400\"},{\"name\":\"sImageWidth\",\"value\":\"266\"},{\"name\":\"imageCropStatus\",\"value\":\"1_1:manual; 4_3:manual; 3_4:manual; 16_9:manual; 9_16:manual; front_thumb:manual; \"},{\"name\":\"credit\",\"value\":\"Michel Verdure\"},{\"name\":\"alternate\",\"value\":\"Image of Royal Caribbean Allure of the Sease\"},{\"name\":\"title\",\"value\":\"Allure of the Seas\"},{\"name\":\"caption\",\"value\":\"Allure of the Seas - At sea, by the coast line of Miami\\nAllure of the Seas - Royal Caribbean International\"},{\"name\":\"datephototaken\",\"value\":\"11-24-2010\"},{\"name\":\"cutline\",\"value\":\"Allure of the Seas - At sea, by the coast line of Miami\\nAllure of the Seas - Royal Caribbean International\"},{\"name\":\"orientation\",\"value\":\"horizontal\"},{\"name\":\"OrigImageName\",\"value\":\"RCI Allure of the Seas.jpg\"},{\"name\":\"imgIndex\",\"value\":\"1371046546001\"},{\"name\":\"imgUniqueName\",\"value\":\"1371046546001-RCI-Test-Seas.jpg\"},{\"name\":\"isImageVisitedByUser\",\"value\":\"True\"},{\"name\":\"isAutoCroppedSetOn\",\"value\":\"True\"},{\"name\":\"publishurl\",\"value\":\"http://www.gannett-cdn.com/media\"},{\"name\":\"rootpath\",\"value\":\"/TEST/GenericImages/2013/06/12/\"},{\"name\":\"basename\",\"value\":\"1371046546001-RCI-Test-Seas.jpg\"},{\"name\":\"smallbasename\",\"value\":\"1371046546001-RCI-Test-Seas_small.jpg\"}],\"contributors\":[],\"id\":2414775,\"propertyID\":1,\"siteid\":1,\"sitename\":\"TEST\",\"assetGroupId\":1,\"assetGroupName\":\"TEST\",\"type\":\"image\",\"typeid\":1,\"typeidSpecified\":true,\"position\":0,\"positionSpecified\":true,\"priority\":null,\"handling\":null,\"status\":\"published\",\"dates\":{\"embargodate\":\"0001-01-01T00:00:00-05:00\",\"feeddateline\":\"0001-01-01T00:00:00-05:00\"},\"TaxonomyEntities\":[],\"assetdocument\":null,\"lastaction\":null,\"CreateDate\":\"2013-06-12T10:19:15.607-04:00\",\"UpdateDate\":\"2013-06-12T10:19:39-04:00\",\"CreateUser\":\"nrifken\",\"UpdateUser\":\"nrifken\",\"LastPublishedDate\":\"2013-06-12T10:19:15.607-04:00\"}"}]
You can use an online tool to view it better (i.e. http://json.parser.online.fr/)
As you can see the "document" is a nested JSON as string and somehow GSON is trying to parse that when I think it shouldn't, I tried setting my Serializable member as String, Object, Map, Map<Object, Object>, etc. but none of them seems to work. Also tried setting it to transient or removing to see if GSON wouldn't bother parsing but still I get:
com.google.gson.JsonSyntaxException: com.google.gson.stream.MalformedJsonException: Unterminated object at line 1 column 72
I think I don't have much control of the deserialization since I'm using RestTemplate's GsonHttpMessageConverter. so I think it's mostly e GSON issue than Springs.
My Model:
public class ShipAsset {
public ShipAsset(String pID, Integer pAssetID,
Integer pShipID, String pDocument, String pAssetType) {
super();
mID = pID;
mAssetID = pAssetID;
mShipID = pShipID;
mDocument = pDocument;
mAssetType = pAssetType;
}
public ShipAsset() {
}
#SerializedName("id")
private String mID;
#SerializedName("assetId")
private Integer mAssetID;
#SerializedName("shipId")
private Integer mShipID;
#SerializedName("document")
private String mDocument;
#SerializedName("assetType")
private String mAssetType;
/* getters and setters */
}
That's how I'm calling it:
ShipAsset[] oResults = mGson.fromJson(oJSONString, ShipAsset[].class);
Anyone have any ideas?
Thanks
The error must be in one of this three things:
1) You are receiving a JSONArray, you are casting like this don't you?:
public class RestFactory {
public static ShipAsset[] getShipsAssets(RestClient restClient) throws Exception {
ResponseEntity<ShipAsset[]> response = restClient.getForEntity(
"http://server/rest/yourmethod", ShipAsset[].class);
return response.getBody();
}
}
2) I'm not sure if It's by this, but you don't have a constructor with all the fields neither an empty contructor. Maybe because isn't a full pojo, Gson isn't casting rightly.
3) Try to annotate the fields id and assetType. I'm pretty sure that if you don't annotate a field with the SerializedName annotation, Gson ignores it by default. But anyways, give it a try!.
Good luck!
Related
Jackson Serialize overloaded output
I have an API which is being extended to be consumed by another system. Pre-req's exist whereby each frontend has different expectations for one json field. Example: The response field 'amount' must be either a String or an int, depending on which value I receive from downstream. So for some instances I will return a string value in the json, while in others I will return int. Expected json outputs: { "amount": 21 } or { "amount": "21" } I have done the following: class Response { #JsonProperty("amount") private int amount; #JsonProperty("amount") private String amountString; // Getters and setters Hoping that I would be able to return either an int or String value for the json field 'amount' but I'm getting the following error: com.fasterxml.jackson.databind.JsonMappingException: Conflicting getter definitions for property "amount" Any help would be appreciated
You can not do that. The element in your JSON is called amount, you can not bind it to 2 different variables. You are getting this exception because the #JsonProperty("amount") is used on 2 seperate class fields. It is best to create 2 different response: Example: class FrontEndResponse1 { #JsonProperty("amount") private int amount; //getter/setter } class FrontEndResponse2 { #JsonProperty("amount") private String amount; //getter/setter }
Yes, this won't work with typed return values. Unless you're fine with providing 2 endpoints with different return types you could return a plain Map<String, Object> instead of Response: public Map<String, Object> awkwardMethod(boolean wantString) { Response response = new Response(); ... // do business logic return Map.of("amount", wantString ? String.value(response.amount) : response.amount); } To be clear: I'm not encouraging you to do this as you'll loose type information for the return value and introduce error prone manual mapping. I'm just providing a solution for a problem that should be fixed by providing a clear API and clients sticking to this API.
How do I convert JSON to Obj for InputText
I have list of json List<String> and each string have json like this {"id":"22","name":"Name","order":"1"} And I want to fetch it to list of input box then when I save it I I want to take all changing and convert them to JSON #ManagedBean #ViewScoped public class LiveStreamController extends ProductController implements Serializable { private static final long serialVersionUID = 5037909267669512508L; private static final Logger LOGGER = LoggerFactory.getLogger(LiveStreamController.class); private LiveStream liveStream; .... } public class LiveStream extends Product implements Serializable { private List<String> jsons = new ArrayList<>(); ... } and I wanna read it <c:forEach items="#{liveStreamController.liveStream.jsons}" var="json "> <h:outputFormat value="#{json.name}" /> <p:inputText value="#{json.order}" /> </c:forEach>
Effectively you are not asking a JSF question but an EL question since the #{json.name} expression is just that... Expression Language. About the 'issue'... If the value of the var="json" is a String, which it in your case is, it will be resolved by the basic resolvers that will for sure know about a String. An attempt will be made to call the property name on the string via a getName() which obviously does not exist, resulting in a Property 'name' not found on type java.lang.String. All of this is also explained in Property 'someproperty' not found on type java.lang.String. Therefor using it like in your example will not work About the solution(s) for reading... There are basically 3 solutions for reading the JSON and displaying it New String EL Resolver You could create a custom EL resolver and put it first in the order of resolvers so that for every string that needs to be resolved checks if it is effectively JSON (minimally parsing it) and if you think it IS JSON, then parse the JSON fully and read/interpret the EL and try to apply it to the JSON object. All this is going to be rather expensive as far as I can see (but BalusC might have a different idea) New JSON EL Resolver The second, a little better solution, is converting the String to a JSON object of you choice (there are many in Java, including a standardized one, 'JSON-P', since Java EE 7 and a newer version for Java EE 8). There is as far as I know no default included EL resolver that knows how to handle these in EL, but examples exist for the non standardized EL formats No idea how this would perform though, testing is knowing. Existing EL Resolver The third option is to convert the JSON to Normally strongly typed objects and then have the normal existing resolvers act on them. This can be Default existing java types like Map, List, String and other normal values, but it could even be more strongly typed like Person , Order, Converting JSON Strings to strongly typed object was a feature that existed in the non-standardized JSON libraries but not in default Java(EE) until Java EE 8, JSON-B. This has an additional advantage that code completion works and validations work in an IDE About the solution(s) for writing... Since you do seem to wanting to write results back to the JSON String (you have an input in your example), the first solution for reading is very hard to extend to writing, and if possible, it would totally break the advantage you seem to want to get of not writing code to be able to use this. The second and third solution both might work but the third has the advantage that input validations can be implemented, like bean validation and more.
create a class: public class JsonWrapper { JsonObject o; public JsonWrapper(String s) { this(new JsonParser().parse(s).getAsJsonObject()); } public JsonWrapper(JsonObject o) { this.o = o; } public String getJsonText() { return o.getAsString(); } public DataWrapper get(String field) { return new DataWrapper(field); } public class DataWrapper { String field; public DataWrapper() { } public DataWrapper(String field) { this.field = field; } public String getData() { return o.get(field).getAsString(); } public void setData(String s) { o.add(field, new JsonPrimitive(s)); } } } convert your live stream to object like this: List<JsonWrapper> jwList = s.stream().map(s1 -> new JsonWrapper(s1)).collect(Collectors.toList()); setter & getter Use it in xhtml <c:forEach items="#{liveStreamController.liveStream.jwList}" var="jw"> <h:outputFormat value="#{jw.get('name').data}" /> <p:inputText value="#{jw.get('order').data}" /> </c:forEach> Use modified data with: List<String> jsonList = jw.stream().map(JsonWrapper::getJsonText).collect(Collectors.toList());
Will Gson set a field to null when JSON doesn't contain it?
I actually have multiple questions regarding Gson. The first one being if Gson would set the value of a field to null when the provided JSON does not contain any field matching it. For example, when the provided JSON features the field name but the class I deserialize it to contains name and avatar, would avatar be null? The next question is in relation to the above one. When I would set a field with an already predefined value, would Gson override it, even if it isn't provided in the JSON (overrides it to null) or would it simply ignore the field and move on? And finally would I want to know if Gson would still set a value to name when I would use #SerializedName("username") but the JSON contains name. I want to update my API, including some bad namings of JSON fields, but I want to make the transition of it for the people using it a smooth as possible, so I want to still (temporary) provide the old field name, while also providing support for the new one. Is that possible using the #SerializedName annotation? I'm still a beginner with Gson and the Gson User Guide wasn't that helpful for me to answer those two specific questions (Or I overlooked it which would also be possible).
I tried implementing this. Here is my code. I hope the output at the end answers your question. JSON used: { "name": "Robert", "weather": "19 deg" } Main class: public class GSONExample2 { private static final String jsonStr = "JSON Mentioned above"; public static void main(String[] args) { GsonDataExample root = new Gson().fromJson(jsonStr, GsonDataExample.class); System.out.println(root); } } POJO: class GsonDataExample { #SerializedName("username") private String name; private String avatar; #SerializedName(value="weather", alternate = "temperature") private String weather; private String nameWithDefault = "Default name"; // getters, setters and toString() implemented } Output: GsonDataExample(name=null, avatar=null, weather=19 deg, nameWithDefault=Default name) To map multiple keys to same attributes, you can use #SerializedName(value="weather", alternate = "temperature") as shown above.
Can not deserialize instance of java.util.ArrayList out of FIELD_NAME token
I have seen others with this same error, but it has been caused by something else so none of the responses have helped me. I have a class called Diff: public class Diff { private String path; private String value; private Operation operation; public enum Operation { ADD, REPLACE, REMOVE } //getters and setters } I need to apply this to a Json object. When working with this, I use the following command on a Diff: mapper.valueToTree(diff); This returns an ObjectNode containing: {"path":"hello","value":"there","operation":"ADD"} I want to turn this into a JsonPatch that will be applied to a JsonNode. To get the JsonPatch, I use the following: JsonPatch jsonPatch = JsonPatch.fromJson(mapper.valueToTree(diff)); This, however, will throw the following exception: Can not deserialize instance of java.util.ArrayList out of FIELD_NAME token Any idea why this is happening? There isn't even an ArrayList involved (to my knowledge)
GSON get string from complex json
I am trying to parse the JSON from this link: https://api.guildwars2.com/v2/items/56 , everything fine until i met the line: "infix_upgrade":{"attributes":[{"attribute":"Power","modifier":4},{"attribute":"Precision","modifier":3}]} ... If i dont get this wrong: infix_upgradehas 1 element attributes inside him. attributes has 2 elements with 2 other inside them. Is this a 2 dimension array? I have tried (code too long to post): JsonObject _detailsObject = _rootObject.get("details").getAsJsonObject(); JsonObject infix_upgradeObject = _detailsObject.get("infix_upgrade").getAsJsonObject(); JsonElement _infix_upgrade_attributesElement = infix_upgradeObject.get("attributes"); JsonArray _infix_upgrade_attributesJsonArray = _infix_upgrade_attributesElement.getAsJsonArray(); The problem is that I dont know what to do next, also tried to continue transforming JsonArray into string array like this: Type _listType = new TypeToken<List<String>>() {}.getType(); List<String> _details_infusion_slotsStringArray = new Gson().fromJson(_infix_upgrade_attributesJsonArray, _listType); but im getting java.lang.IllegalStateException: Expected STRING but was BEGIN_OBJECT which i guess comes from the attributes...
With a proper formatting (JSONLint, for example, checks if the JSON data is valid and does the formatting, which makes the structure more clear than what the GW link gives), attributes looks actually like this: "attributes": [ { "attribute": "Power", "modifier": 4 }, { "attribute": "Precision", "modifier": 3 } ] So it's an array of JsonObject and each object as two key-value pairs. This is why the parser throws an error because you require that this array contains only String which is not the case. So the actual type is: Type _listType = new TypeToken<List<JsonObject>>(){}.getType(); The problem is that I dont know what to do next Hold on. You are using Gson and Java is an OO language so I suggest you to create classes. This would be easier for you to fetch the datas afterward and for the parsing since you just need to provide the class of the actual class the JSON data represents to the parser (some edge-cases could be handled by writing a custom serializer/deserializer). The data is also better typed than this bunch of JsonObject/JsonArray/etc. This will give you a good starting point: class Equipment { private String name; private String description; ... #SerializedName("game_types") private List<String> gameTypes; ... private Details details; ... } class Details { ... #SerializedName("infix_upgrade") private InfixUpgrade infixUpgrade; ... } class InfixUpgrade { private List<Attribute> attributes; ... } class Attribute { private String attribute; private int modifier; ... } and then just give the type to the parser: Equipment equipment = new Gson().fromJson(jsonString, Equipment.class); Hope it helps! :)