I have a shared library placed in libs/armeabi folder. It is loaded using
System.loadLibrary("library_name.so");
The size of the library is around 3MB. The loading time is very long. It sometimes last almost 20 seconds. It blocks my GUI. I tried to put System.loadLibrary("library_name.so"); in a different thread but my GUI is still blocked. I know that others apps use even bigger .so files, but the loading time is not so big. What could be the problem?
EDIT
3MB was the size of the debug version. Release version is about 800KB, but the problem is the same. Some additional info:
.so contains my two c++ libraries which are circularly connected
running arm-linux-androideabi-nm -D -C -g library_name.so displays a lot of functions and variables
I don't use LOCAL_WHOLE_STATIC_LIBRARIES anymore
here are the section headers table obtained by using arm-linux-androideabi-readelf-tool:
Section Headers:
[Nr] Name Type Addr Off Size ES Flg Lk Inf Al
[ 0] NULL 00000000 000000 000000 00 0 0 0
[ 1] .dynsym DYNSYM 00000114 000114 00b400 10 A 2 1 4
[ 2] .dynstr STRTAB 0000b514 00b514 015b0c 00 A 0 0 1
[ 3] .hash HASH 00021020 021020 004d1c 04 A 1 0 4
[ 4] .rel.dyn REL 00025d3c 025d3c 006e98 08 A 1 0 4
[ 5] .rel.plt REL 0002cbd4 02cbd4 000468 08 A 1 6 4
[ 6] .plt PROGBITS 0002d03c 02d03c 0006b0 00 AX 0 0 4
[ 7] .text PROGBITS 0002d6f0 02d6f0 08e6e0 00 AX 0 0 8
[ 8] .ARM.extab PROGBITS 000bbdd0 0bbdd0 00bad0 00 A 0 0 4
[ 9] .ARM.exidx ARM_EXIDX 000c78a0 0c78a0 005b80 08 AL 7 0 4
[10] .rodata PROGBITS 000cd420 0cd420 005cc0 00 A 0 0 4
[11] .data.rel.ro.loca PROGBITS 000d46d8 0d36d8 0006e4 00 WA 0 0 4
[12] .fini_array FINI_ARRAY 000d4dbc 0d3dbc 000008 00 WA 0 0 4
[13] .init_array INIT_ARRAY 000d4dc4 0d3dc4 00009c 00 WA 0 0 4
[14] .data.rel.ro PROGBITS 000d4e60 0d3e60 00384c 00 WA 0 0 8
[15] .dynamic DYNAMIC 000d86ac 0d76ac 000100 08 WA 2 0 4
[16] .got PROGBITS 000d87ac 0d77ac 000854 00 WA 0 0 4
[17] .data PROGBITS 000d9000 0d8000 000648 00 WA 0 0 8
[18] .bss NOBITS 000d9648 0d8648 047271 00 WA 0 0 8
[19] .comment PROGBITS 00000000 0d8648 000026 01 MS 0 0 1
[20] .note.gnu.gold-ve NOTE 00000000 0d8670 00001c 00 0 0 4
[21] .ARM.attributes ARM_ATTRIBUTES 00000000 0d868c 00002d 00 0 0 1
[22] .shstrtab STRTAB 00000000 0d86b9 0000d8 00 0 0 1
Try to reduce number of exported functions in your shared library. You can use
arm-linux-androideabi-nm -D -C -g library_name.so
and check if that list is unnecessarily long, and remove the ones that you don't use (declare them static). You can look up nm's manual by $man nm and read about how to use and interpret it.
If you need to use lots of functions, use RegisterNatives() to register your functions instead of relying on name mangling and lookup - that's what you do when you give your functions names like Java_your_path_YourClass_yourFunction.
You can also try to strip (arm-linux-androideabi-strip) your library, if it has symbols.
To avoid blocking UI, you can try to load your shared library early in a different thread and wait for it.
I wouldn't use LOCAL_WHOLE_STATIC_LIBRARIES, if exposing static libraries is not what I ultimately want.
LOCAL_WHOLE_STATIC_LIBRARIES
These are the static libraries that you want to include in your module without allowing the linker to remove dead code from them.
This is mostly useful if you want to add a static library to a shared library and have the static library's content exposed from the shared library.
Try to fix that problem instead of working around some build problem.
The problem is static initialization in some constructor which takes to much time to finishis
Related
I have 5 images
sun.png
moon.png
sea.png
earth.png
sky.png
I put these images into pdf via pdf box and
I am able to identify the instance of PDImageXObject
PDXObject pdxObject = getResources().getXObject(objectName);
if (pdxObject instanceof PDImageXObject) {
//I want earth.png
PDImageXObject image = (PDImageXObject)xobject;
BufferedImage bImage = image.getImage();
String fileName='earth.png'; // How can I get same file name as it was at the time of placing on pdf
ImageIO.write(bImage,"PNG",new File(fileName));
System.out.println("earth saved.");
}
But how can I determine that this PDImageXObject is earth.png one? ; and
How can I get same file name as it was at the time of placing on pdf
There is no clear way to decide on number of images in a PDF without considering what you mean by images.
It is not as simple as counting visible content, nor use an extraction listing. Here are 5 images on the page, but the page is considered as only having one image, even though I can drag and scale the smaller copies. However, none have names that say Sun Moon Earth and Sea. They did as sun, moon, earth & sea.png but in a PDF they are given different names and ALL 5 are placed in the file as /Im0 but allocated different object numbers and different IDentity descriptions, It does not matter how many places they are linked to, nor total number of copies, they will simply be known by placements, so often the writer will keep it brief as /Im0 /Im1 /Im2 etc. Thus I was slightly surprised to see here there is only /Im0. But I suppose its how you count as a "page canvas media" when overlaying.
Each image has its own "fixed page" but we don't count images as pages here they are called a "form".
<</BBox[0 0 430 430]/Type/XObject/Length 39/Resources<</XObject<</Im0 16 0 R>>>>/Subtype/Form>>
stream
q
430 0 0 430 0 0 cm
/Im0 Do
Q
q
Q
q
Q
endstream
endobj
13 0 obj
<</BBox[0 0 430 430]/Type/XObject/Length 39/Resources<</XObject<</Im0 17 0 R>>>>/Subtype/Form>>
stream
q
430 0 0 430 0 0 cm
/Im0 Do
Q
q
Q
q
Q
endstream
endobj
14 0 obj
<</BBox[0 0 430 430]/Type/XObject/Length 39/Resources<</XObject<</Im0 18 0 R>>>>/Subtype/Form>>
stream
q
430 0 0 430 0 0 cm
/Im0 Do
So Mutool (base for pyMuPDF) agrees in "info" query
Images (1): 1 (4 0 R): [ ASCIIHex ] 1720x860 8bpc DevRGB (10 0 R)
Ok that expected lets extract
extracting image-0010.png
extracting image-0015.png
extracting image-0016.png
extracting image-0017.png
extracting image-0018.png
extracting image-0019.png
extracting image-0020.png
extracting image-0021.png
extracting image-0022.png
So that's expected too there is one image and 8 other different images each a sub layer(s) of the 4 visible.
earth is 16 and 20
moon is 17 and 21
sea is 18 and 22
sun is 15 and 19
However those 8 different pngs are nothing like the source pngs since they are simply shadows of the inputs.
The inter relationship is seen better in
pdfimages -list clipboard4.pdf
page num type width height color comp bpc enc interp object ID x-ppi y-ppi size ratio
--------------------------------------------------------------------------------------------
1 0 image 1720 860 rgb 3 8 image no 10 0 96 96 8803K 203%
1 1 image 430 430 rgb 3 8 image no 15 0 249 249 1100K 203%
1 2 smask 430 430 gray 1 8 image no 15 0 249 249 367K 203%
1 3 image 430 430 rgb 3 8 image no 16 0 160 160 1100K 203%
1 4 smask 430 430 gray 1 8 image no 16 0 160 160 367K 203%
1 5 image 430 430 rgb 3 8 image no 17 0 288 288 1100K 203%
1 6 smask 430 430 gray 1 8 image no 17 0 288 288 367K 203%
1 7 image 430 430 rgb 3 8 image no 18 0 198 198 1100K 203%
1 8 smask 430 430 gray 1 8 image no 18 0 198 198 367K 203%
This question already has answers here:
Using the non final loop variable inside a lambda expression
(3 answers)
Closed 3 years ago.
I have a list of ints like the following one:
1318 1065 0
1392 1109 0
1522 1114 2
1764 1134 0
1643 1172 0
1611 1141 0
1608 1142 4
1689 1180 0
1546 1144 0
1811 1121 1
1682 1144 0
1687 1203 0
1751 1138 0
1702 1227 0
My goal is to keep only entries where the third element is a 0.
I've tried a few things like:
for( int i=0; i<data_fin.size();i++) {
data_fin.removeIf(s -> !((data_fin.get(i)[2]) == 0));
}
I get the error 'Local variable i defined in an enclosing scope must be final or effectively final'.
Can anyone help me understand what I'm doing wrong? I'm quite new to Java and I'm probably using removeif wrong, so I would appreciate the help!
My goal is to keep only entries where the third element is a 0
You don't need a loop in this, all you need is :
data_fin.removeIf(a -> a[2] != 0);
I think Java doesn't provide much in their API about getting processes, is there a way that you could get a parent's process PID/ID in Java?
If you're running on Linux you can check procfs using /proc/self/stat.
Following from #Imz's answer, on Linux, grab the output of /proc/self/stat (it's a one-line file, so just read it like a normal file)
43732 (java) S 43725 43725 11210 34822 43725 4202496 127791 387073
4055 0 3188 79 4597 253 20 0 53 0 16217706 39231705088 188764
18446744073709551615 4194304 4196452 140735605394256 140735605376816
274479481597 0 0 2 16800973 18446744073709551615 0 0 17 13 0 0 0 0 0
The 4th field (in bold above) is your parent process id
Here's a sample dataset of a much larger data file, I need to load into mysql db. The problem is the dataset is too large to manually add/append the insert statements and put the commas at the right locations.
E 1
T 2006-11-02 22:01:34
U 6 andrevan
N 70 node_ue
V 1 62 2004-09-11 05:50:00 node
V 1 27 2004-09-11 06:13:00 slowking
V 1 11 2004-09-11 06:50:00 merovingian
V 1 34 2004-09-11 12:11:00 norm
V 1 10 2004-09-11 13:30:00 anárion
V 1 55 2004-09-11 15:20:00 thecustomoflife
V 1 28 2004-09-11 15:21:00 neutrality
V 1 8 2004-09-11 16:56:00 lst27
V 1 63 2004-09-11 18:00:00 zchangu
V 1 5 2004-09-11 19:51:00 orthogonal
V 1 26 2004-09-12 03:04:00 grunt
V -1 25 2004-09-12 03:46:00 blankfaze
V 1 56 2004-09-12 22:00:00 guanaco
V 1 64 2004-09-12 22:51:00 beau99
V 1 19 2004-09-13 00:51:00 ffirehorse
V 1 20 2004-09-13 01:27:00 michael
V 1 7 2004-09-14 19:49:00 texture
V 1 65 2004-09-16 05:01:00 friedmilk
V 1 66 2004-09-17 13:56:00 ezhiki
V 1 39 2004-09-18 07:34:00 squash
Can someone please suggest the best way to load this into mysql db using JDBC?
Thanks!
The best way is to use MySQL LOAD DATA INFILE (http://dev.mysql.com/doc/refman/5.6/en/load-data.html). Using this method, you can tell it to use tab delimited format and skip the first x rows.
If you need to run this from Java, you can wrap the call in Java code. For example on how this is done, you can see how Pentaho project is doing it: https://github.com/pentaho/pentaho-kettle/blob/master/engine/src/org/pentaho/di/trans/steps/mysqlbulkloader/MySQLBulkLoader.java/ Or this simple blog entry: http://jeffrick.com/2010/03/23/bulk-insert-into-a-mysql-database/.
Speaking from experience, this is definitely not a job for JDBC as it will cause too much performance bottleneck. However if for whatever reason you need to use JDBC, just make sure that you use PreparedStatement and batch the rows. Spring has a very good implementation that you can leverage. For example on this use: http://www.mkyong.com/spring/spring-jdbctemplate-batchupdate-example/. Of course you also need to make sure that you stream the file and read line by line accordingly to avoid out of memory.
Need a hint so I can convert a huge (300-400 mb) ASCII file to a CSV file.
My ASCII file is a database with a lot of products (about 600,000 pcs = 55,200,000 lines in the file).
Below is ONE product. It is like a tablerow in a database, with 88 columns.
If you count the below lines, there is 92 lines.
For every time we have the '00I+CR\LF' it indicates, that we have a new row/product.
Each line is ended with a CR+LF.
A whole product/row is ended with the following three lines:
A00
A10
A21
-as shown below.
Between the starting line '00I CR+LF' and the three ending lines, we have lines, starting with 2 digits (column name), and what comes after those digits, is the data for the column.
If we take the first line below the starting line '00I CR+LF' we will see:
'0109321609'. 01 indicates that it is the column named 01, and the rest is the data stored in that column: '09321609'.
I want to strip out the two digits, indicating each column name/line-number, so the first line (after the starting indication '00I'): 0109321609 comes out as the following: ”09321609”.
Putting it together with the next line (02), it should give an output like:
”09321609”,”15274”, etc.
When coming to the end, we want a new row.
The first line '00I' and the three last lines 'A00', 'A10' and 'A21' we don't want to be included in the output file.
Here is how a row looks like (every line is ended by a CR+LF):
00I
0109321609
0215274
032
0419685
05
062
072
081
09
111
121
15
161
17
1814740
1920120401
2020120401
2120120401
22
230
240
251
26BLAHBLAH 1000MG
27
281
29
30
31BLAHBLAH 1000 mg Filmtablets Hursutacinzki
32
3336
341
350
361
371
401
410
420
43
445774
45FTA
46
47AN03AX14
48BLAHBLAH00000000000000000000010
491
501
512
522
5317
542
552
561
572
581
591
60
61
62
631
641
65
66
67
681
69
721
74884
761
771
780
790
801
811
831
851474
86
871
880
891
901
911
922
930
941
951
961
97
98
990
A00
A10
A21
Anyone got a hint on how it can be converted?
The file is too big for a webserver with php and mysql to run. My thought was to put the file in a directory on my local server, and read the file, strip out the line numbers, and insert the data directly in a mysql database on the fly, but the file is too big, and the server stalls.
I'm able to run under Linux (Ubuntu) and Windows 7.
Maybe some python or java is recommended? I'm able to run both, but my experience with those is low, but I'm a quick learner, so if someone can give a hint? :-)
Best Regards
Bjarke :-)
If you are absolutely certain that each entry is 92 lines long:
from itertools import izip
import csv
with open('data.txt') as inf, open('data.csv','wb') as outf:
lines = (line[2:].rstrip() for line in inf)
rows = (data[1:89] for data in izip(*([lines]*92)))
csv.writer(outf).writerows(rows)
It should be like this in python.
import csv
fo = csv.writer(open('out.csv','wb'))
with open('eg.txt', 'r') as f:
for line in f:
assert line[:3] == '00I'
buf = []
for i in range(88):
line = f.next()
buf.append(line.strip()[2:])
line = f.next()
assert line[:3] == 'A00'
line = f.next()
assert line[:3] == 'A10'
line = f.next()
assert line[:3] == 'A21'
fo.writerow(buf)