[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: HTTPAPI performance problems



   Hi Rainer,
   and thank you for email. Now I'm almost sure that the problem is not
   with httpapi but internally.�   If it is working for you in a more stressful��environment it should
   also work for me.
   Have a nice day,
   Radu

   On Tue, Sep 15, 2015 at 1:09 PM, Rainer Ross <[1]rainer_ross@xxxxxx>
   wrote:

     � �Hi Radu,
     � �I use the "http_url_get_raw" with 25.000 request every day and
     � �I tested it with 100 parallel requests. There was never a
     � �performance problem.
     � �Rainer
     � �Am 15.09.2015 um 12:17 schrieb Radu Botescu:
     � �Hi Paul,
     � �thx for you ideea. I'll try.
     � �In the meantime I've found in one of the programs a little
     instruction
     � �which I think makes the difference.... a lock of a *dtaara just
     before
     � �calling the½ "http_url_post_xml"...and the *dtaara is never
     unlocked.½
     � �So if another program is running it will be in wait until the
     first one
     � �finished and unlock the *dtaara ...and so on and so on...
     � �I'll do a new version, remove the lock (because there is no
     need to
     � �modify this *dtaara...) and see the performances.
     � �Thank you again,
     � �Radu½
     � �On Tue, Sep 15, 2015 at 12:00 PM, Paul Roy
     [1]<[1][2]paul.roy@xxxxxxx> wrote:
     � � �½� ½ what happens if you limit the number of parallel
     jobs to 3-4 ?
     � � �½� ½ you could try to use a jobq with max active to 3/4..
     � � �½� ½ Paul
     � � �½� ½ From:½� ½� ½� ½� Radu Botescu
     [2]<[2][3]rbotescu@xxxxxxxxx>
     � � �½� ½ To:½� ½� ½� ½� HTTPAPI and FTPAPI Projects
     � � �[3]<[3][4]ftpapi@xxxxxxxxxxxxxxxxxxxxxx>
     � � �½� ½ Date:½� ½� ½� ½� 15/09/2015 10:10
     � � �½� ½ Subject:½� ½� ½� ½� HTTPAPI performance
     problems
     � � �½� ½ Sent by:½� ½� ½� ½�     [[4]4][5]ftpapi-bounces@xxxxxxxxxxxxxxxxxxxxxx
     � � �½� ½
     � � �½
     __________________________________________________________________
     � �½� ½ Hello, I've implemented the httpapi with success but i
     have some

   � �½� ½ performance problems when using it in many calls in
   parallel.
   � �½� ½ Let me explain and sorry if it is long...
   � �½� ½ I call an external webservice in order to get a shipping
   label.
   � �One
   � �½� ½ label
   � �½� ½ per parcel.
   � �½� ½ Now if on a palette I have 10 parcels I need to call 10
   times the
   � �same
   � �½� ½ webservice.
   � �½� ½ There are 2 ways to do it:
   � �½� ½ 1. In sequence. Parcel 1, parcel 2....parcel 10. If I have
   3-4
   � �seconds
   � �½� ½ per
   � �½� ½ label ==> the last label will be printed after 30-40
   seconds.
   � �½� ½ 2. In parallel. This is the current solution. I submit in
   batch
   � �one job
   � �½� ½ per
   � �½� ½ parcel/label. Thus I have 10 jobs running in parallel. One
   label
   � �is
   � �½� ½ very
   � �½� ½ fast, 2-3 seconds. The longest is 20-25 seconds. So
   overall it is
   � �½� ½ better
   � �½� ½ but I do have a big problem bc for at least one label I
   wait too
   � �½� ½ much...20-25 seconds...After 2-3 labels the processing
   time is
   � �starting
   � �½� ½ to
   � �½� ½ be longer...
   � �½� ½ How it works:
   � �½� ½ 1. I call a Program A in order to create a xml file in ifs
   (need
   � �to log
   � �½� ½ the
   � �½� ½ files and have a history....)
   � �½� ½ 2. I call a Program B in order to consume this xml file
   with
   � �½� ½ "http_url_post_xml" . I parse the answer. I also write the
   label
   � �(ZPL
   � �½� ½ code)
   � �½� ½ to a IFS file.
   � �½� ½ 3. I write some tracking information and print the label
   � �½� ½ The bottleneck is in the step 2.
   � �½� ½ The debug is *ON. I prefer to have all the logs at least
   for
   � �several
   � �½� ½ months.
   � �½� ½ I've spoke with my client and on his side he has between 1
   and 2
   � �½� ½ secondes
   � �½� ½ of processing time.
   � �½� ½ I do not understand where is the bottleneck...too many IFS
   � �operations
   � �½� ½ in
   � �½� ½ parallel? Is somewhere something in httpapi which force
   several
   � �½� ½ parallel
   � �½� ½ jobs to be processed in sequence ? I do not thing so...
   � �½� ½ Any idea will be much appreciate :)
   � �½� ½ Thanks,
   � �½� ½ Radu
   � �½� ½ --
   � �½� ½ R.

     � � �½
     � � �½
     ------------------------------------------------------------------
     � � �-----
     � � �½� ½ This is the FTPAPI mailing list.½� To unsubscribe,
     please go
     � � �to:
     � � �½� ½
     [1][5][5][6]http://www.scottklement.com/mailman/listinfo/ftpapi
     � � �½
     � � �½
     ------------------------------------------------------------------
     � � �-----
     � � �References
     � � �½� ½ 1.
     [6][6][7]http://www.scottklement.com/mailman/listinfo/ftpapi
     � �     �------------------------------------------------------------------
     --
     � � �---
     � � �This is the FTPAPI mailing list.½� To unsubscribe, please
     go to:
     � � �[7][7][8]http://www.scottklement.com/mailman/listinfo/ftpapi
     � �     �------------------------------------------------------------------
     --
     � � �---
     � �--
     � �R.
     References
     � �1. [8]mailto:[9]paul.roy@xxxxxxx
     � �2. [9]mailto:[10]rbotescu@xxxxxxxxx
     � �3. [10]mailto:[11]ftpapi@xxxxxxxxxxxxxxxxxxxxxx
     � �4. [11]mailto:[12]ftpapi-bounces@xxxxxxxxxxxxxxxxxxxxxx
     � �5. [12][13]http://www.scottklement.com/mailman/listinfo/ftpapi
     � �6. [13][14]http://www.scottklement.com/mailman/listinfo/ftpapi
     � �7. [14][15]http://www.scottklement.com/mailman/listinfo/ftpapi
     --------------------------------------------------------------------
     ---
     This is the FTPAPI mailing list.� To unsubscribe, please go to:
     [15][16]http://www.scottklement.com/mailman/listinfo/ftpapi
     --------------------------------------------------------------------
     ---
     References
     � �1. mailto:[1][17]paul.roy@xxxxxxx
     � �2. mailto:[2][18]rbotescu@xxxxxxxxx
     � �3. mailto:[3][19]ftpapi@xxxxxxxxxxxxxxxxxxxxxx
     � �4. mailto:[20]4][21]ftpapi-bounces@xxxxxxxxxxxxxxxxxxxxxx
     � �5. [22]http://www.scottklement.com/mailman/listinfo/ftpapi
     � �6. [23]http://www.scottklement.com/mailman/listinfo/ftpapi
     � �7. [24]http://www.scottklement.com/mailman/listinfo/ftpapi
     � �8. mailto:[25]paul.roy@xxxxxxx
     � �9. mailto:[26]rbotescu@xxxxxxxxx
     � 10. mailto:[27]ftpapi@xxxxxxxxxxxxxxxxxxxxxx
     � 11. mailto:[28]ftpapi-bounces@xxxxxxxxxxxxxxxxxxxxxx
     � 12. [29]http://www.scottklement.com/mailman/listinfo/ftpapi
     � 13. [30]http://www.scottklement.com/mailman/listinfo/ftpapi
     � 14. [31]http://www.scottklement.com/mailman/listinfo/ftpapi
     � 15. [32]http://www.scottklement.com/mailman/listinfo/ftpapi
     --------------------------------------------------------------------
     ---
     This is the FTPAPI mailing list.� To unsubscribe, please go to:
     [33]http://www.scottklement.com/mailman/listinfo/ftpapi
     --------------------------------------------------------------------
     ---

   --
   R.

References

   1. mailto:rainer_ross@xxxxxx
   2. mailto:paul.roy@xxxxxxx
   3. mailto:rbotescu@xxxxxxxxx
   4. mailto:ftpapi@xxxxxxxxxxxxxxxxxxxxxx
   5. mailto:ftpapi-bounces@xxxxxxxxxxxxxxxxxxxxxx
   6. http://www.scottklement.com/mailman/listinfo/ftpapi
   7. http://www.scottklement.com/mailman/listinfo/ftpapi
   8. http://www.scottklement.com/mailman/listinfo/ftpapi
   9. mailto:paul.roy@xxxxxxx
  10. mailto:rbotescu@xxxxxxxxx
  11. mailto:ftpapi@xxxxxxxxxxxxxxxxxxxxxx
  12. mailto:ftpapi-bounces@xxxxxxxxxxxxxxxxxxxxxx
  13. http://www.scottklement.com/mailman/listinfo/ftpapi
  14. http://www.scottklement.com/mailman/listinfo/ftpapi
  15. http://www.scottklement.com/mailman/listinfo/ftpapi
  16. http://www.scottklement.com/mailman/listinfo/ftpapi
  17. mailto:paul.roy@xxxxxxx
  18. mailto:rbotescu@xxxxxxxxx
  19. mailto:ftpapi@xxxxxxxxxxxxxxxxxxxxxx
  20. mailto:4
  21. mailto:ftpapi-bounces@xxxxxxxxxxxxxxxxxxxxxx
  22. http://www.scottklement.com/mailman/listinfo/ftpapi
  23. http://www.scottklement.com/mailman/listinfo/ftpapi
  24. http://www.scottklement.com/mailman/listinfo/ftpapi
  25. mailto:paul.roy@xxxxxxx
  26. mailto:rbotescu@xxxxxxxxx
  27. mailto:ftpapi@xxxxxxxxxxxxxxxxxxxxxx
  28. mailto:ftpapi-bounces@xxxxxxxxxxxxxxxxxxxxxx
  29. http://www.scottklement.com/mailman/listinfo/ftpapi
  30. http://www.scottklement.com/mailman/listinfo/ftpapi
  31. http://www.scottklement.com/mailman/listinfo/ftpapi
  32. http://www.scottklement.com/mailman/listinfo/ftpapi
  33. http://www.scottklement.com/mailman/listinfo/ftpapi
-----------------------------------------------------------------------
This is the FTPAPI mailing list.  To unsubscribe, please go to:
http://www.scottklement.com/mailman/listinfo/ftpapi
-----------------------------------------------------------------------