|
|
请使用QQ关联注册PLM之家,学习更多关于内容,更多精彩原创视频供你学习!
您需要 登录 才可以下载或查看,没有账号?注册
x
http://www-cad.fnal.gov/PLMWorld2008/Teamcenter%20Unified/The%2520Network%2520is%2520Slow!.pdf * v7 E% H0 o x. C' t
http://www.plmworld.org/p/bl/et/blogid=43&blogaid=218
7 V' P; u: _% n! w* L0 Ehttps://support.industrysoftware.automation.siemens.com/docs/teamcenter/Network_Performance_Tuning_V6.6.pdf2 g/ ]9 \% j! A! K3 b9 }
@) u4 H% H; O; B, d( B5 WTeamcenter is Slow! Teamcenter Performance Bottlenecks & Mitigation6 N8 Z/ b) f' Y
* W" [9 V$ V( F2 |" m* m1 a
Larry Carpenter
( y: q) U* {8 r8 y$ d' n- U R( [9 jAt the Chicago-Wisconsin RUG Fall Conference in October 2012, I gave a presentation on common Teamcenter performance issues and solutions along with listing, in one place, many other past Teamcenter performance presentations and white papers. It was very well received by a standing room crowd, so I thought I'd share it with the rest of the PLM World community. Here is a link to the presentation (you must be a TCUA SIG member to view it): http://www.plmworld.org/p/do/sd/sid=3758&type=0. R8 N+ f5 Z, G
For those unwilling to join the TcUA SIG to view it, I wrote an abbreviated version here:
, I; L/ _ G5 B, q' P- Y" IWhy Performance Matters
9 O1 b4 x9 D, b( F' B$ I: X7 m• Productivity – doing more work with less( q+ d* o, m! [) F6 |8 L
o Improve end user productivity9 S7 g* ]% M& O5 N! s! }
o Improves administrator productivity
X, n( x+ @# O t. E3 }2 f fewer help desk calls responding to or fixing preventable problems
& c' [3 c3 e7 G' r( d( @) D. o5 q$ j• Reliability2 W4 v5 d. x0 B! k, R" p
o A well tuned Teamcenter environment also improves system stability and uptime.
4 g! n- l+ y' T! \, o4 zo Less opportunity for data corruption
7 v" j# v- ~1 A+ yo Fewer operational errors/problems
! T" r. { h1 d: S• Cost Savings2 |- S* U0 T+ @: Z
o Less waiting means less time wasted.+ \* ^! i( _( }3 k1 t' @/ @% n
Quick Case Study: Company ‘S’& n6 ]& m% H6 ~
Performance was so bad that something which used to take 10 minutes was taking 2 hours to do.Did pretty much everything wrong, performance-wise, at first but ultimately fixed every major problem. What took 2 hours now only takes 2 minutes.
1 n1 l! g- Q! H: X* [& nSee my March 2012 article on PLM World’s website for details:: r' Z0 l- ^, L' i) H
Teamcenter Performance – Hard-Earned Lessons: http://www.plmworld.org/p/bl/ar/blogaid=152
$ @# Y0 s* h2 q1 JCommon Performance Bottleneck Causes: }5 g+ J- H8 y& o2 f" C
Using OOTB settings — OOTB settings are intended for development environments; not production environments.
* n5 G7 w4 q! u6 POverloaded servers — Putting too much on a single server.; E: a5 F; i/ c8 ~1 I0 L' g' r
Operating system settings — Network settings most common (e.g. TCP parameters).. e2 G, v/ {) M; ]8 u
Lack of performance monitoring & tuning — Performance doesn’t improve all by itself. It requires human intervention to determine root cause and address it.
8 d! l4 I* @0 V" l( p1 x5 ~Databases – The Most Likely Culprit
7 i$ e' D. e3 D0 O/ x8 U0 C2 C* K! I. l: G• Database performance is highly sensitive to hardware, software, and DB configuration.
6 ~4 T3 U3 [2 j- W$ a. S2 k* B• DBAs at companies generally don’t do performance monitoring and tuning of your Teamcenter DB.
# `# t2 X/ C7 a; N* ^/ ]• It’s typically the last place that Teamcenter administrators look for performance issues rather than the first.
9 j$ B; Q5 s. o/ @' j X. aMitigating Database Server Bottlenecks
9 d! b; Z, K( w: v! Q• Must use dedicated DB server; F# Z/ _* @, E- c3 L, Z5 b
o Do not use your DB server for anything other than your Teamcenter production database. This includes not serving additional databases from the same server.
( ?6 v, d* Z4 z. P/ f• Must have fast dedicated storage for DB files
, _+ E, j; R5 P# w, To Avoid using a NAS device; especially a shared NAS. Use DAS (Direct Attached Storage) instead.
7 H( L% v2 H4 ~- _/ go Use multiple fast disk spindles partitioned with proper RAID levels according to the DB vendor & SPLM recommendations.1 M% I! l+ ?, w/ i5 L0 s9 z
o Split DB data, temp, and log files across those RAID partitions according to DB vendor & SPLM recommendations.
% b; d; e0 Y Z, ?" Vo Use disk controllers with a battery/flash backed cache. e& r4 s0 G' r! m/ N7 }/ a
o Use multiple disk controllers if possible.1 N7 N; p! r e4 h5 E
• Cram the RAM
' ~, l1 L! c2 K n' [- u5 vo Ideally should be greater than the database size or in-memory footprint. Otherwise disk swapping/paging will occur.$ w/ A( O5 j1 `* ~6 G# s! ~
• Use 64-bit OS & DB software9 s! s, [4 t! P/ @; B
o 32-bit software has severe limitations regardless of whether you use “/3G”, AWE, or PAE settings to access memory beyond 3-4G. It’s still a bottleneck.
2 D3 i/ D- c/ F• Use a good quality network adapter(s). H. W: y5 v3 s( }& Q. C# M
o Often overlooked as potential source of bottleneck (e.g. packets/sec limitations). Consider multiple NICs “trunked” for better throughput.. v9 s; z; g' D
• DB maintenance tasks
1 D, L2 I; k( d5 r$ X4 N0 u2 Uo Update statistics and rebuild indexes regularly.
0 G# k1 U( M& t+ T8 S) B& ECommon Teamcenter Server Bottleneck Causes6 X- x9 M& m( A2 A8 f
• Overloaded Tc Servers
6 J( S0 S, Q& F" m5 ~8 }' V• Poor Web Tier Configuration
) v# B u7 B# A( I• Poor FMS Configuration5 ?6 P: [ N) w8 X
• Debugging Turned ON
9 e' a' i8 f" S9 k/ s( Z" R• Rich Client using OOTB settings
5 v7 Q3 O( [, n3 @2 X: b; L‘Unload’ Overloaded Teamcenter Servers! {4 @- u5 z, E# V% v1 b/ h
• Put Dispatcher modules on separate computers away from other Tc Servers.
' p6 K0 M: G: d _4 [+ f7 _: q• Separate the Web & Enterprise tiers from the Tc Corporate and Volume servers.
5 s) n6 o/ G% n/ E2 ^* T• Use load balancing for Middle Tier & FMS:
! S3 O* S8 p6 M k2 `o Use multiple Web/Enterprise Tier servers to open up potential hardware resource bottlenecks (e.g. CPU, RAM, network adapter I/O, disk I/O, MB bus, etc.).0 u* E9 o7 G, W7 `
o Set up multiple FSC cache servers to take load off busy volume servers/storage.
+ j0 p n' D: x* w) r8 F/ WWeb Tier Configuration/ H4 j/ f x5 @- @# U
• Do not use port 80 or 8080
: w; p+ h0 N# a+ Ro HTTP traffic on those ports is considered web browsing traffic and is therefore given lowest priority on any network. Can also cause randomly dropped connections.
& o; l8 r' S6 m2 {) R1 x, V, w• Enable http compression if not using WAN acceleration: _1 F6 o* f5 V. j2 d$ b4 A
o Must be done on both web server and on clients to take effect.
+ B/ y( |- a& g• Change/tune OOTB settings for Web Server/App
, {% `, D T4 s! t& W4 Fo E.g. timeout values, max # of threads, Java memory, etc.! ?8 C! V- u$ \% R9 E9 G( T/ n% e& w
o Read tuning guides specific to your chosen web server/app# g: H6 v/ S' f- N
• Scale it up or sideways
" V* A. u# s k3 G6 o4 io Add another web tier server, or increase # of work processes (e.g. Web Garden mode for IIS).2 V/ N6 Y. E/ j& i
Common FMS Bottleneck Causes* u ?& I* i4 h7 r
• Data improperly routed, v0 y- r4 q; q
o E.g. Forcing data to go through a remote FSC server over a WAN and back again over the same WAN instead of simply pulling it directly from a nearby Volume/cache server.4 N+ X8 j& x5 V2 V Z Q: ^; a
• Using OOTB settings# Z* c% X( J; ~" H* R; g1 |
o For development purposes only, remember?
3 H* q% E6 S# |9 L6 b7 e- T• Missing client IP address subnets3 B: j/ A; A' {+ D7 Y6 d1 L
• No load balancing" K% _9 y- i- h% y. |! j
• Not using remote cache servers for WAN users
! a# @" t% [; ]# E0 _• Not using remote volume servers for WAN users
4 D, k! \7 D* A" q/ ^; bFMS Configuration5 t/ T4 w. T& w$ v* d8 F4 h
• Ensure routing is correct# u. [6 U; k K, x7 ^1 b% N
o Between multiple FSC groups via entry/exit/link parameters
' N+ Z2 D2 E6 g8 g+ Ao Between clients and their assigned FSC servers by using complete and accurate ‘clientmap’ parameters for ALL clients.
) @3 e/ |: \# q% Vo Use correct transport algorithms for LAN and WAN users.# l* N8 l! d+ Z/ o" p W
• Tune FSC/FCC cache settings3 A+ o8 u: \) Y+ V+ } B
o Simply picking a total read/write cache size is not enough.
9 _: J1 X* Z4 K( o: r! |o Read “Sizing the FMS fast cache” in the Teamcenter help documentation. There is also a FMS cache sizing tool available from the GTAC web site. Link to FMS Calculator
5 b2 Y4 L. }9 Y% H& H+ m• Ensure correct client maps6 @* `; P5 ^6 p& o( B
o Determine ALL potential client IP address ranges and where they are located. Don’t forget to account for VPN IP addresses.4 J/ E$ V/ l' R
o Place client maps in the closest FSC group to their location.4 v5 P) ]! o ^- M! ]) u( V
• Use multiple FSCs for load balancing
5 i+ i' V$ C. N7 h; P1 go Use “front-end” FSC cache servers to reduce load on Volume servers. (Requires disabling of FSC direct routing)
. g5 q) |' |% b* g5 l, X N' ?4 |o Use redundant FSC cache servers to load balance each other. Also provides fail-over.9 v2 r/ G+ M* j: Y, d
• Place FSC cache servers close to users
. p, x0 h0 k: A/ n% jo Greatly improves read performance (load time) over a WAN for groups consuming shared data.
, ]( ]! u8 q# v• Place Volume servers close to users
f {. @: b6 K; Y0 _! to Use Store & Forward or at least place remote volumes near remote users. (Backups of remote volumes are critical)4 n1 f+ `6 M# Y% a
o Greatly improve write performance (save time) over a WAN especially for CAD data.
) _8 m9 ]# o. M) Q7 w• Prepopulate FSC caches2 J8 ^" ]/ q2 l
o Run a nightly script to prepopulate shared data across FSC caches.
" p0 Z5 m# i8 g3 W2 V9 C) VMisc Teamcenter Changes
) d' y8 T$ N9 `8 q, Q; S* h+ K• Disable logging and other debugging tools. Turn them on only when needed. Examples,9 w( U' Q6 V2 s
o TC_SECURITY_LOGGING=OFF
6 ?# j& w: k* f+ k s! i0 r- fo TC_APPLICATION_LOGGING=OFF1 v$ _# {. z+ i5 m
o TC_SLOW_SQL=-1" w0 _- P/ v; X0 X
• Rich Client ‘Teamcenter.ini’ configuration:1 z+ i: ~* `6 R7 D
o Modify Teamcenter.ini file to increase Java Memory and other settings. Will improve performance/stability when perform large operations (CAD, PSE expansion, large Workflows)./ K) l, w- i1 Y4 l. K
• Enable FCC File Warming
) i$ y7 _+ {1 K# C$ o( O" E8 lo Improve startup time by having FCC and Tc files pre-loaded at OS login.! E$ C! x, J# y g0 a0 n# l5 _
Network Performance
' R. d9 F; p; k; f$ b& \• Use a hardware-based WAN accelerator if using Teamcenter between multiple facilities over a WAN.
& N4 K, ]' G. e& Oo If none then make best use of software-based Web server and FMS WAN acceleration settings. (i.e. http compression & FMS compression)( u) _) f% C+ r" T& S/ h ]: m+ Z
• Optimize OS network settings
- z7 ?1 N* a( Io OOTB settings are insufficient
7 C3 _! S* G7 z# A/ D# ?+ N3 b; jo Applies to both servers and clients- E) R1 p9 z4 _
o Examples, increasing # of tcp ports, disabling NAGLE algorithm, increasing buffer sizes, trunking multiple NICs, enabling Compound TCP, Large Windows Scaling
, g3 Z* ]- ^5 l9 o4 FRecommended Server Changes (Windows)
& r% r! U/ O3 ^6 KSee Presentation.0 k# |. }/ t& h. i3 t
Recommended Client Changes (Windows)
9 r$ i; [6 H3 A* \+ D! \; zSee Presentation./ V L8 L$ i+ l5 B+ k% P: O$ ~0 i/ ?5 Q
Performance Monitoring Tools8 I1 Q3 l1 ~* P; @8 i" g# V
• Some useful performance monitoring tools:
- i) {- M' w4 ^' p• Performance Monitor (comes with Windows)$ u+ w! ?: B* A* \& b8 j# f4 C
• Used to monitor OS, Teamcenter, and SQL use of resources$ H# U8 y% C% t' E( Q
• Wireshark (freeware network packet sniffer)+ i4 i# S. M3 X$ O# S% N" g' D
• Used to help identify network TCP performance between computers.& f) \# l; H+ H9 K+ v- H) J v; d
• Available at http://www.wireshark.org/7 }! ]# |% {- y1 q9 ~
• Sysinternals Suite (free from Microsoft web site)
3 H& w) ~+ Y) t/ R# V: V• http://technet.microsoft.com/en-us/sysinternals/bb842062" T( x7 h0 ]) b i. E2 Q! Z3 `
Reference Materials/ O! A$ ~, [# F& m: e* m1 j$ B. `
• Available on GTAC Web Site @ http://support.industrysoftware.automation.siemens.com/docs/teamcenter/' V* Y8 ?. a8 Y
o Teamcenter Deployment Guide2 y) p! v- a$ @: L Z5 R8 U. }
o Teamcenter Network Performance Tuning& Y; a, X4 }' Y0 Q
o JBoss 4.2.2 Installation & Tuning Guide/ }7 Q, J' q( Z: Q2 l2 _
o Optimizing Teamcenter Client Performance; A; x: q% c' i5 N( y
o Teamcenter System Performance Analysis z5 F' P6 r! x
• Oracle documentation & web sites
; i# N# Z/ h6 s; l. e4 Y& B• MS SQL Server documentation in addition to:
$ h5 \( p* r; L. E# ]5 Qo Best Practices for Running Siemens Teamcenter on SQL Server
+ X7 d, I0 v( S) j0 c http://download.microsoft.com/download/7/3/6/7365D2BB-BB34-4D28-A128-F2C8FBA6E995/Siemens-Teamcenter-and-SQL-Server-Best-Practices.pdf8 c# n6 y6 [0 H' B u( L
o Siemens Blog on Technet
: J* w7 L3 z8 U# |' B' h http://blogs.technet.com/b/sql_server_isv/archive/tags/siemens/. i3 K: g) m6 f8 D
o Siemens-Teamcenter-SQL-Resource-Page* ^+ z& s j0 W8 f- U' L+ H% w
http://blogs.technet.com/b/sql_server_isv/p/siemens-teamcenter-sql-server-resource-page.aspx, I E8 b8 [1 F" _; ~! y
• Past PLM World Conference Presentations available at www.plmworld.org,+ b8 o U# p# h6 ^ ^9 y1 u0 j r
o Teamcenter 4-Tier Deployment – Best Practices
1 J# }1 p* O' P& [; {o Teamcenter – Database Performance+ z0 m& V# R& ]6 ?. }& k
o JBoss Optimization for Teamcenter/ Z% l) M2 U0 i; f7 q9 b
o Optimizing Teamcenter Client Performance3 G4 |# c$ @; \. R
o Teamcenter Database Server Configuration & Tuning' n7 ]* U6 I9 Z8 O% Y' r
Contact Information2 L+ X8 H% e+ R* N/ W
Larry Carpenter P.E., PLM World Teamcenter SIG Chair, tcua@plmworld.org: U: {; u/ }7 {' ~7 d; i" G
Teamcenter UA SIG: http://www.plmworld.org/TC_UA1 p% A/ u. g5 `7 \" m( A- j3 j) C
LinkedIn: http://www.linkedin.com/pub/larry-carpenter-pe/44/5b8/aaa
' E1 W0 i C% cAlternate Contact Info: ideas2nx@plmworld.org, larry.carpenter@siemens.com0 i; Y3 f: x1 q4 k8 o' Y
5 I+ d B8 Y/ i |
|