<div dir="ltr"><div>Hi Takehiro,</div><div><br></div><div>Generally speaking, DiFX is pretty robust to having servers with different capabilities, since the time division multiplexing that is used will happily allocate fewer subintegrations to the slower nodes and more to the faster ones. If the throughput does not go up when you add more processing resources, you are not compute bound, but must instead be either:</div><div><br></div><div>1) input voltage read bound;</div><div>2) output visibility write bound; or</div><div>3) network I/O bound (either a) in the voltage send from the datastream reading nodes, or b) in the visibility subintegration assembly at the manager node)</div><div><br></div><div>It would be fairly rare for case 2) to be the problem, unless you have short integration times, many baselines, and many channels. If you have a decent network, and you are not doing very short subintegrations with lots of channels, it would also be unusual for case 3b) to be the problem. So that leaves the voltage data read or send - either getting it off disk in the first place, or away from the read node to the processing nodes.</div><div><br></div><div>Can you let us know what your correlator topology is? Is this reading from commodity disk, Mark5/Mark6, or...? What hardware are the datastream nodes running on, and what network connectivity do they have? And what is the read rate that is being achieved (i.e., what is the per-antenna datarate, and the correlation speed-up factor [correlate time divided by obs time for a given job]?)</div><div><br></div><div>Cheers,</div><div>Adam</div></div><br><div class="gmail_quote gmail_quote_container"><div dir="ltr" class="gmail_attr">On Mon, 6 Jul 2026 at 20:47, 西 健宏 via Difx-developers <<a href="mailto:difx-developers@listmgr.nrao.edu">difx-developers@listmgr.nrao.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Dear colleagues,<br>
<br>
Hello.<br>
My name is Takehiro Nishi, in the Geospatial Information Authority of Japan (GSI).<br>
GSI is responsible for correlating some of the geodetic VLBI sessions of IVS.<br>
<br>
I'm writing to inquire about processing correlation environment.<br>
<br>
Currently, GSI is trying to improve the processing speed of "DiFX", since the processing time didn’t improve when we added three new servers for distributed processing. <br>
We need to optimize our system, but we are not sure where the bottle neck is.<br>
Therefore, I would appreciate it if you could inform us of your processing environment to help our investigation as below:<br>
<br>
・the number of processes written in .machines files : <br>
・the number of threads written in .threads files : <br>
・the capacity of memory for each server : <br>
・the total number of cores : <br>
・the total number of processing servers : <br>
・Are the number of cores and memory on the servers uniform, or are they varied?<br>
:<br>
<br>
Thank you for your cooperation.<br>
<br>
<br>
Best regards,<br>
Takehiro<br>
GSI<br>
<br>
---------------------------------------------------------------<br>
Takehiro Nishi<br>
Space Geodesy Division<br>
Geodetic Department<br>
Geospatial Information Authority of Japan (GSI)<br>
E-mail: <a href="mailto:nishi-t96pc@mlit.go.jp" target="_blank">nishi-t96pc@mlit.go.jp</a><br>
---------------------------------------------------------------<br>
<br>
<br>
_______________________________________________<br>
Difx-developers mailing list<br>
<a href="mailto:Difx-developers@listmgr.nrao.edu" target="_blank">Difx-developers@listmgr.nrao.edu</a><br>
<a href="https://listmgr.nrao.edu/mailman/listinfo/difx-developers" rel="noreferrer" target="_blank">https://listmgr.nrao.edu/mailman/listinfo/difx-developers</a><br>
</blockquote></div><div><br clear="all"></div><br><span class="gmail_signature_prefix">-- </span><br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr" style="font-size:12.8px"><div dir="ltr" style="font-size:12.8px"><div dir="ltr" style="font-size:12.8px"><div dir="ltr" style="font-size:12.8px"><div dir="ltr" style="font-size:12.8px"><div dir="ltr" style="font-size:12.8px">!=============================================================!<br><div dir="ltr" style="font-size:12.8px">Prof. Adam Deller </div></div><div style="font-size:12.8px">Centre for Astrophysics & Supercomputing </div><div dir="ltr" style="font-size:12.8px">Swinburne University of Technology <br>John St, Hawthorn VIC 3122 Australia</div><div style="font-size:12.8px">phone: +61 3 9214 5307</div><div style="font-size:12.8px">fax: +61 3 9214 8797</div><div style="font-size:12.8px">!=============================================================!</div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>