607 lines
15 KiB
JSON
607 lines
15 KiB
JSON
[
|
|
{
|
|
"start": 1749.0,
|
|
"end": 1751.3999999,
|
|
"text": "Thanks, Annie. Okay. Good."
|
|
},
|
|
{
|
|
"start": 1751.48,
|
|
"end": 1755.64,
|
|
"text": "Okay. I have a question a couple of questions in the chat."
|
|
},
|
|
{
|
|
"start": 1757.88,
|
|
"end": 1758.92,
|
|
"text": "Performers,"
|
|
},
|
|
{
|
|
"start": 1758.92,
|
|
"end": 1761.559999,
|
|
"text": "what is the best part? So that's Brian, Justin,"
|
|
},
|
|
{
|
|
"start": 1762.12,
|
|
"end": 1762.679999,
|
|
"text": "I think."
|
|
},
|
|
{
|
|
"start": 1763.415,
|
|
"end": 1765.815,
|
|
"text": "Sorry if I missed the"
|
|
},
|
|
{
|
|
"start": 1765.815,
|
|
"end": 1766.695,
|
|
"text": "the order."
|
|
},
|
|
{
|
|
"start": 1769.095,
|
|
"end": 1774.775,
|
|
"text": "The best practice around how much compute resources should be allocated to the server based on the load."
|
|
},
|
|
{
|
|
"start": 1777.76,
|
|
"end": 1780.08,
|
|
"text": "So this is a little bit like the"
|
|
},
|
|
{
|
|
"start": 1780.800001,
|
|
"end": 1782.08,
|
|
"text": "egg and"
|
|
},
|
|
{
|
|
"start": 1782.96,
|
|
"end": 1784.48,
|
|
"text": "chicken question"
|
|
},
|
|
{
|
|
"start": 1785.2,
|
|
"end": 1786.16,
|
|
"text": "because"
|
|
},
|
|
{
|
|
"start": 1786.8,
|
|
"end": 1791.84,
|
|
"text": "load for one person is different for another. So we do have the capacity guide,"
|
|
},
|
|
{
|
|
"start": 1792.575,
|
|
"end": 1799.855,
|
|
"text": "which has a very nice table showing key what exactly we had been testing with to get specific results"
|
|
},
|
|
{
|
|
"start": 1800.575,
|
|
"end": 1802.575,
|
|
"text": "from where we can interpret."
|
|
},
|
|
{
|
|
"start": 1803.295002,
|
|
"end": 1808.83,
|
|
"text": "What we also know is that there are operations on the server, for example, PGP,"
|
|
},
|
|
{
|
|
"start": 1809.07,
|
|
"end": 1811.47,
|
|
"text": "which are very CPU and memory,"
|
|
},
|
|
{
|
|
"start": 1814.11,
|
|
"end": 1814.99,
|
|
"text": "exhaustive."
|
|
},
|
|
{
|
|
"start": 1815.07,
|
|
"end": 1817.87,
|
|
"text": "So depending on what you are doing exactly,"
|
|
},
|
|
{
|
|
"start": 1819.275,
|
|
"end": 1822.235,
|
|
"text": "you might need to play with that."
|
|
},
|
|
{
|
|
"start": 1822.555,
|
|
"end": 1825.675,
|
|
"text": "So the way I would start when I'm doing"
|
|
},
|
|
{
|
|
"start": 1827.115005,
|
|
"end": 1827.995,
|
|
"text": "resources"
|
|
},
|
|
{
|
|
"start": 1827.995,
|
|
"end": 1831.435005,
|
|
"text": "is, first of all, as I mentioned, the install guide was updated."
|
|
},
|
|
{
|
|
"start": 1831.97,
|
|
"end": 1836.29,
|
|
"text": "So we have a new minimum requirement for both CPUs and memory."
|
|
},
|
|
{
|
|
"start": 1836.53,
|
|
"end": 1842.85,
|
|
"text": "For example, on the server, the absolute minimum will require now is four CPUs and 60 gigabytes of memory,"
|
|
},
|
|
{
|
|
"start": 1843.09,
|
|
"end": 1846.61,
|
|
"text": "but this is for a very slow small systems. Still production, but small."
|
|
},
|
|
{
|
|
"start": 1849.115005,
|
|
"end": 1851.435005,
|
|
"text": "As long as if you are in a proper"
|
|
},
|
|
{
|
|
"start": 1851.755005,
|
|
"end": 1855.195,
|
|
"text": "production environment, I would usually recommend doubling that."
|
|
},
|
|
{
|
|
"start": 1856.235,
|
|
"end": 1858.475006,
|
|
"text": "So four to eight CPUs"
|
|
},
|
|
{
|
|
"start": 1858.475006,
|
|
"end": 1859.995,
|
|
"text": "with"
|
|
},
|
|
{
|
|
"start": 1859.37,
|
|
"end": 1865.29,
|
|
"text": "32 gigabyte of memory is a great start for pretty much any environment that is not on the very small scale."
|
|
},
|
|
{
|
|
"start": 1865.69,
|
|
"end": 1869.53001,
|
|
"text": "Obviously, if you're going to go million, like, million files per day,"
|
|
},
|
|
{
|
|
"start": 1870.170006,
|
|
"end": 1871.93,
|
|
"text": "then you need to go a little larger."
|
|
},
|
|
{
|
|
"start": 1873.525,
|
|
"end": 1874.485,
|
|
"text": "So it's"
|
|
},
|
|
{
|
|
"start": 1876.005005,
|
|
"end": 1877.60501,
|
|
"text": "that's where it starts."
|
|
},
|
|
{
|
|
"start": 1877.685,
|
|
"end": 1878.32501,
|
|
"text": "So"
|
|
},
|
|
{
|
|
"start": 1878.565,
|
|
"end": 1883.525,
|
|
"text": "do you have what kind of transformations are you doing? So what happens to your files when they are coming?"
|
|
},
|
|
{
|
|
"start": 1885.56999,
|
|
"end": 1890.93001,
|
|
"text": "Brian? Yeah. That's perfect. And I'm also I'm also on the same team as Jeff at Wells Fargo."
|
|
},
|
|
{
|
|
"start": 1891.41,
|
|
"end": 1894.05,
|
|
"text": "Okay. And so, yeah, essentially,"
|
|
},
|
|
{
|
|
"start": 1894.05,
|
|
"end": 1896.13,
|
|
"text": "there's there's all sorts of, you know,"
|
|
},
|
|
{
|
|
"start": 1896.45,
|
|
"end": 1902.225,
|
|
"text": "just like you said, different types of loads, which is great to account into the consideration,"
|
|
},
|
|
{
|
|
"start": 1903.025,
|
|
"end": 1926.2050199999999,
|
|
"text": "which I wasn't accounting for. So that's great. And I'll definitely have to keep an eye on that. And I really do appreciate that you noted that that stuff has been updated in the install guide. So I'll be sure to go ahead and check those out for further details, but that's that's a great idea and a great starting point for us. So thank you. Yeah. And because I happen to know your environment very well, all of them, actually,"
|
|
},
|
|
{
|
|
"start": 1927.80501,
|
|
"end": 1931.88501,
|
|
"text": "just read whatever and then double it and then start thinking again."
|
|
},
|
|
{
|
|
"start": 1932.205,
|
|
"end": 1934.52501,
|
|
"text": "It's my recommendation for your environment."
|
|
},
|
|
{
|
|
"start": 1934.845,
|
|
"end": 1937.40501,
|
|
"text": "You're on the bigger scale, always had been."
|
|
},
|
|
{
|
|
"start": 1938.205,
|
|
"end": 1938.52501,
|
|
"text": "So"
|
|
},
|
|
{
|
|
"start": 1940.65001,
|
|
"end": 1946.65001,
|
|
"text": "other from that, a couple of things to remind to mention, especially if you're building new environments,"
|
|
},
|
|
{
|
|
"start": 1946.65001,
|
|
"end": 1947.77002,
|
|
"text": "do baselines."
|
|
},
|
|
{
|
|
"start": 1948.09001,
|
|
"end": 1951.93001,
|
|
"text": "Figure out how long something takes to the server and run it carefully"
|
|
},
|
|
{
|
|
"start": 1951.93001,
|
|
"end": 1954.65001,
|
|
"text": "or at least once a day to see if it's still behaving."
|
|
},
|
|
{
|
|
"start": 1955.55501,
|
|
"end": 1964.51501,
|
|
"text": "You you will never know if the server is getting overloaded if you don't have a baseline to compare to, and this bass baseline need to be cleaned. Right?"
|
|
},
|
|
{
|
|
"start": 1965.475,
|
|
"end": 1973.09001,
|
|
"text": "You cannot just compare one file today to another tomorrow. They have nothing to do with it in terms of where it's coming from or where it's going to."
|
|
},
|
|
{
|
|
"start": 1974.29001,
|
|
"end": 1975.41002,
|
|
"text": "The other thing,"
|
|
},
|
|
{
|
|
"start": 1975.8899999999999,
|
|
"end": 1977.73001,
|
|
"text": "in your kind of environments,"
|
|
},
|
|
{
|
|
"start": 1978.85,
|
|
"end": 1982.21,
|
|
"text": "and this is very large environment, but there's also it's valid everywhere."
|
|
},
|
|
{
|
|
"start": 1982.55501,
|
|
"end": 1983.835,
|
|
"text": "For the last"
|
|
},
|
|
{
|
|
"start": 1984.07501,
|
|
"end": 1986.71501,
|
|
"text": "maybe ten years, in my experience,"
|
|
},
|
|
{
|
|
"start": 1987.27501,
|
|
"end": 1988.475,
|
|
"text": "the biggest"
|
|
},
|
|
{
|
|
"start": 1988.55501,
|
|
"end": 1989.5149999999999,
|
|
"text": "bottleneck"
|
|
},
|
|
{
|
|
"start": 1989.5149999999999,
|
|
"end": 1993.67502,
|
|
"text": "always ends up being the file system we're putting the files onto."
|
|
},
|
|
{
|
|
"start": 1993.99501,
|
|
"end": 1995.595,
|
|
"text": "It's not ST itself"
|
|
},
|
|
{
|
|
"start": 1996.79001,
|
|
"end": 2003.03001,
|
|
"text": "because we had been increasing the capacity. It's usually the NFS or whatever you you are using behind it."
|
|
},
|
|
{
|
|
"start": 2003.59001,
|
|
"end": 2011.19,
|
|
"text": "So or the network separation point or something similar like that, something outside of ST. Because people tend to"
|
|
},
|
|
{
|
|
"start": 2011.675,
|
|
"end": 2018.475,
|
|
"text": "make their ST very sturdy and make it a huge application and then forget that we actually need to talk to the file system,"
|
|
},
|
|
{
|
|
"start": 2018.875,
|
|
"end": 2020.715,
|
|
"text": "and we need a network in and out,"
|
|
},
|
|
{
|
|
"start": 2021.115,
|
|
"end": 2025.35498,
|
|
"text": "and we need access to the LDAP if you are doing LDAP for authentication and things like that."
|
|
},
|
|
{
|
|
"start": 2026.37,
|
|
"end": 2030.37,
|
|
"text": "So whenever you or if you use iCAP for antivirus,"
|
|
},
|
|
{
|
|
"start": 2030.37,
|
|
"end": 2033.41,
|
|
"text": "if your iCAP engine can only handle three files per hour,"
|
|
},
|
|
{
|
|
"start": 2034.0500200000001,
|
|
"end": 2039.97,
|
|
"text": "I have some news for you. Your OST will not be able to handle more either because we need to wait on them. Right?"
|
|
},
|
|
{
|
|
"start": 2041.165,
|
|
"end": 2041.80502,
|
|
"text": "So"
|
|
},
|
|
{
|
|
"start": 2042.125,
|
|
"end": 2043.085,
|
|
"text": "Absolutely."
|
|
},
|
|
{
|
|
"start": 2043.165,
|
|
"end": 2045.405,
|
|
"text": "Things like that. Things outside."
|
|
},
|
|
{
|
|
"start": 2046.045,
|
|
"end": 2047.96503,
|
|
"text": "And talking about that,"
|
|
},
|
|
{
|
|
"start": 2048.365,
|
|
"end": 2051.885,
|
|
"text": "the one thing that I would point out is archiving."
|
|
},
|
|
{
|
|
"start": 2051.885,
|
|
"end": 2054.445,
|
|
"text": "So we did a huge amount of work"
|
|
},
|
|
{
|
|
"start": 2054.765,
|
|
"end": 2055.325,
|
|
"text": "on"
|
|
},
|
|
{
|
|
"start": 2055.7200000000003,
|
|
"end": 2058.04,
|
|
"text": "getting our archiving"
|
|
},
|
|
{
|
|
"start": 2059.08002,
|
|
"end": 2060.52002,
|
|
"text": "to work a little better."
|
|
},
|
|
{
|
|
"start": 2061.64,
|
|
"end": 2063.96002,
|
|
"text": "For the ones that are not familiar,"
|
|
},
|
|
{
|
|
"start": 2063.96002,
|
|
"end": 2067.08002,
|
|
"text": "archiving is a feature you can enable in ST,"
|
|
},
|
|
{
|
|
"start": 2067.32,
|
|
"end": 2074.1549999999997,
|
|
"text": "which while we're writing the file on the file system, we write a second copy in the archive folder, and this is what is used for REST submit."
|
|
},
|
|
{
|
|
"start": 2074.63498,
|
|
"end": 2082.79498,
|
|
"text": "So it's a very nice thing to turn on. But until half a year ago, we recommended big environments to actually disable it because it was a hack on resources."
|
|
},
|
|
{
|
|
"start": 2083.31,
|
|
"end": 2084.67,
|
|
"text": "We finally fixed that."
|
|
},
|
|
{
|
|
"start": 2085.23,
|
|
"end": 2089.79,
|
|
"text": "So now it's we actually recommend it to be enabled till now you can have resubmit cleanly."
|
|
},
|
|
{
|
|
"start": 2089.87003,
|
|
"end": 2096.99002,
|
|
"text": "But please, please, please don't put the archive folder on the same shared storage where your file home folders are,"
|
|
},
|
|
{
|
|
"start": 2097.615,
|
|
"end": 2104.255,
|
|
"text": "because I've seen people doing that. First of all, archive in the same folder as the actual storage makes no sense whatsoever,"
|
|
},
|
|
{
|
|
"start": 2104.495,
|
|
"end": 2105.775,
|
|
"text": "operation.net."
|
|
},
|
|
{
|
|
"start": 2106.175,
|
|
"end": 2115.14,
|
|
"text": "But the bigger problem is that now we have a double IO operation during the receiving of the file going on the same disk that is already struggling."
|
|
},
|
|
{
|
|
"start": 2115.53998,
|
|
"end": 2116.74,
|
|
"text": "So don't do that."
|
|
},
|
|
{
|
|
"start": 2117.38,
|
|
"end": 2124.41998,
|
|
"text": "And just as a base rule, if you have two storages and one of them is better than the other in terms of resources, IO, memory, you know,"
|
|
},
|
|
{
|
|
"start": 2125.145,
|
|
"end": 2130.745,
|
|
"text": "use the better one for home folders, the worst one for archiving. Archiving has a single write"
|
|
},
|
|
{
|
|
"start": 2130.98502,
|
|
"end": 2138.025,
|
|
"text": "during the receiving of the file and a single read if and it's only happening a read only if there is a resubmit needed."
|
|
},
|
|
{
|
|
"start": 2139.9700000000003,
|
|
"end": 2140.69,
|
|
"text": "So"
|
|
},
|
|
{
|
|
"start": 2141.17,
|
|
"end": 2142.13,
|
|
"text": "makes sense?"
|
|
},
|
|
{
|
|
"start": 2144.61002,
|
|
"end": 2149.41,
|
|
"text": "Graham? Yeah. That's excellent. Thank you so much. Okay. Talking about resubmit,"
|
|
},
|
|
{
|
|
"start": 2149.89,
|
|
"end": 2156.4049999999997,
|
|
"text": "how many people saw in the August release that we have a multiple resubmit through the UI."
|
|
},
|
|
{
|
|
"start": 2157.365,
|
|
"end": 2167.125,
|
|
"text": "My new server died, so I cannot show you. But you don't if you have more than one resubmit to be done, we actually get the and it's it's not an API based,"
|
|
},
|
|
{
|
|
"start": 2167.285,
|
|
"end": 2178.13,
|
|
"text": "unfortunately. They're looking into it. But as long as you can get them on the same page on the UI, you can hit a single resubmit button and resubmit multiple transfers at the same time now."
|
|
},
|
|
{
|
|
"start": 2181.33,
|
|
"end": 2183.56998,
|
|
"text": "No one cares. Okay. I had mentioned it."
|
|
},
|
|
{
|
|
"start": 2185.385,
|
|
"end": 2186.105,
|
|
"text": "Okay."
|
|
},
|
|
{
|
|
"start": 2186.98502,
|
|
"end": 2188.42502,
|
|
"text": "Anything else, Brian?"
|
|
},
|
|
{
|
|
"start": 2190.665,
|
|
"end": 2192.825,
|
|
"text": "No. That's it for me. Thank you so much."
|
|
},
|
|
{
|
|
"start": 2194.665,
|
|
"end": 2195.305,
|
|
"text": "Absolutely."
|
|
},
|
|
{
|
|
"start": 2197.19,
|
|
"end": 2201.1900299999998,
|
|
"text": "Okay. Let me give me a second to see just something."
|
|
},
|
|
{
|
|
"start": 2201.51,
|
|
"end": 2204.79,
|
|
"text": "And I saw the other question is about the port changes."
|
|
},
|
|
{
|
|
"start": 2205.91,
|
|
"end": 2209.03003,
|
|
"text": "The release notes has the exact requirements"
|
|
},
|
|
{
|
|
"start": 2209.03003,
|
|
"end": 2210.55002,
|
|
"text": "for the disk to be successful,"
|
|
},
|
|
{
|
|
"start": 2210.88498,
|
|
"end": 2217.125,
|
|
"text": "and it has a couple of links as well. So I'll start start with the September build release notes, Jacob."
|
|
},
|
|
{
|
|
"start": 2220.005,
|
|
"end": 2220.885,
|
|
"text": "Okay."
|
|
},
|
|
{
|
|
"start": 2222.965,
|
|
"end": 2224.16498,
|
|
"text": "I'll take a look at that."
|
|
},
|
|
{
|
|
"start": 2224.87,
|
|
"end": 2230.87,
|
|
"text": "Yep. And, also, we published somewhere on the support site an article explaining some of the differences."
|
|
},
|
|
{
|
|
"start": 2231.43,
|
|
"end": 2238.79,
|
|
"text": "I don't have a handy link at the moment. If you cannot find it, I'll see if I can find it so we can I we can send it later, but it's pretty straightforward?"
|
|
},
|
|
{
|
|
"start": 2239.875,
|
|
"end": 2241.23502,
|
|
"text": "From your perspective,"
|
|
},
|
|
{
|
|
"start": 2241.715,
|
|
"end": 2248.275,
|
|
"text": "as so if you look through the release notes, it will tell you you need to create additional OS level user, for example,"
|
|
},
|
|
{
|
|
"start": 2248.755,
|
|
"end": 2255.84,
|
|
"text": "for the replication to work and things like that. But it is listed as the prerequisite for the update on the September release."
|
|
},
|
|
{
|
|
"start": 2256.56,
|
|
"end": 2257.76,
|
|
"text": "And it's very,"
|
|
},
|
|
{
|
|
"start": 2258.15997,
|
|
"end": 2263.92,
|
|
"text": "very clearly spelling out if you're on Windows, if you're on appliance, if you're on Linux, do this, this, this."
|
|
},
|
|
{
|
|
"start": 2265.69696,
|
|
"end": 2266.25696,
|
|
"text": "So,"
|
|
},
|
|
{
|
|
"start": 2266.57697,
|
|
"end": 2268.337,
|
|
"text": "it it's pretty straightforward,"
|
|
},
|
|
{
|
|
"start": 2268.337,
|
|
"end": 2270.57697,
|
|
"text": "at least which ports need to be opened,"
|
|
},
|
|
{
|
|
"start": 2270.897,
|
|
"end": 2272.0969999999998,
|
|
"text": "who needs to talk to whom."
|
|
}
|
|
] |