|
|
请使用QQ关联注册PLM之家,学习更多关于内容,更多精彩原创视频供你学习!
您需要 登录 才可以下载或查看,没有账号?注册
×
http://www-cad.fnal.gov/PLMWorld2008/Teamcenter%20Unified/The%2520Network%2520is%2520Slow!.pdf
" b/ F/ e0 e# M% j* }1 Mhttp://www.plmworld.org/p/bl/et/blogid=43&blogaid=218
! P$ q, c N0 ]7 @7 N7 t4 p1 V- Vhttps://support.industrysoftware.automation.siemens.com/docs/teamcenter/Network_Performance_Tuning_V6.6.pdf
1 j/ u" {& X! u+ W+ s9 D l, p. x6 J" b/ T) N: J
Teamcenter is Slow! Teamcenter Performance Bottlenecks & Mitigation9 E' g9 F+ @, T! ^5 R. }4 l
2 d' s- s3 R: k9 E, T0 N! |/ KLarry Carpenter ]% Z6 f% \+ ?/ @
At the Chicago-Wisconsin RUG Fall Conference in October 2012, I gave a presentation on common Teamcenter performance issues and solutions along with listing, in one place, many other past Teamcenter performance presentations and white papers. It was very well received by a standing room crowd, so I thought I'd share it with the rest of the PLM World community. Here is a link to the presentation (you must be a TCUA SIG member to view it): http://www.plmworld.org/p/do/sd/sid=3758&type=0
$ `6 f* m/ r' k* R2 ]% s6 tFor those unwilling to join the TcUA SIG to view it, I wrote an abbreviated version here:
3 j$ q" H8 x' |; b4 pWhy Performance Matters
8 w( ~2 d. v& z, p! b0 |* [. D• Productivity – doing more work with less
, L, q5 D: G* m7 F, w. D1 Oo Improve end user productivity
( M% \6 k4 |; C+ R! t( Io Improves administrator productivity
. {! s5 F$ j: d fewer help desk calls responding to or fixing preventable problems
! B4 |7 h& B8 D& s0 X• Reliability
+ K$ |) T2 h$ t7 z7 p+ L h; So A well tuned Teamcenter environment also improves system stability and uptime.5 f# I5 Z$ u9 }5 Q# ^7 }; z
o Less opportunity for data corruption1 W6 x" p" ~, ?. W) a0 d
o Fewer operational errors/problems6 y. }( {. ~% \+ m
• Cost Savings* k3 p7 O$ N J0 f0 X, T$ {
o Less waiting means less time wasted.
Y1 t1 x; s- r- bQuick Case Study: Company ‘S’
, P5 d- y+ p% E( X' h( c rPerformance was so bad that something which used to take 10 minutes was taking 2 hours to do.Did pretty much everything wrong, performance-wise, at first but ultimately fixed every major problem. What took 2 hours now only takes 2 minutes.
5 G8 |9 {( k% [1 [! I0 B9 L+ VSee my March 2012 article on PLM World’s website for details:
@. E# ?6 S# _; P% Q" L& WTeamcenter Performance – Hard-Earned Lessons: http://www.plmworld.org/p/bl/ar/blogaid=152
, U9 l* S- N$ ZCommon Performance Bottleneck Causes
& i; z( R* T6 L$ }& aUsing OOTB settings — OOTB settings are intended for development environments; not production environments.
% Q" |8 J5 P# J2 V; C' k0 HOverloaded servers — Putting too much on a single server.0 u& B8 {/ ?3 E& v4 {/ q
Operating system settings — Network settings most common (e.g. TCP parameters).
, C' @( V3 Y0 j4 {" tLack of performance monitoring & tuning — Performance doesn’t improve all by itself. It requires human intervention to determine root cause and address it.
# L9 N: b/ P+ `. x) e9 D1 M2 jDatabases – The Most Likely Culprit
, k m1 Z# _( P( H! p }• Database performance is highly sensitive to hardware, software, and DB configuration./ V$ w! F" h$ t* C( K: h
• DBAs at companies generally don’t do performance monitoring and tuning of your Teamcenter DB.
. _$ z$ b# J6 A( d• It’s typically the last place that Teamcenter administrators look for performance issues rather than the first.( B5 i. f9 k# X7 n- O: y
Mitigating Database Server Bottlenecks
N0 Z! z' a F% K/ y0 M• Must use dedicated DB server) j+ }3 o S9 E
o Do not use your DB server for anything other than your Teamcenter production database. This includes not serving additional databases from the same server.
8 A. p' t; a- z9 W6 B% K• Must have fast dedicated storage for DB files- K% v0 M( X7 x; y* s
o Avoid using a NAS device; especially a shared NAS. Use DAS (Direct Attached Storage) instead.- d; {& c* i; _( b4 x- S% {5 G
o Use multiple fast disk spindles partitioned with proper RAID levels according to the DB vendor & SPLM recommendations.4 \/ f1 l( S8 a
o Split DB data, temp, and log files across those RAID partitions according to DB vendor & SPLM recommendations.
2 L+ v- c1 V0 K0 \6 ~o Use disk controllers with a battery/flash backed cache.
# l4 R; q# q9 i5 v4 Y, Q" n* Ho Use multiple disk controllers if possible.
d& J5 k3 n5 y% C9 T• Cram the RAM4 @8 v& t. {/ i4 W
o Ideally should be greater than the database size or in-memory footprint. Otherwise disk swapping/paging will occur.
/ o' g2 X& M+ X) y0 N" Q• Use 64-bit OS & DB software
. a2 B4 Y9 M/ h5 Q# ?3 Jo 32-bit software has severe limitations regardless of whether you use “/3G”, AWE, or PAE settings to access memory beyond 3-4G. It’s still a bottleneck.
; I3 B) C, ?. N& a• Use a good quality network adapter(s)5 n: s. l% P8 E( F8 p( r
o Often overlooked as potential source of bottleneck (e.g. packets/sec limitations). Consider multiple NICs “trunked” for better throughput.
5 }+ I9 h8 V; Y) s9 o$ u• DB maintenance tasks3 h+ n4 N8 q4 I/ F9 ~! y
o Update statistics and rebuild indexes regularly.; X; k' I. y# d0 e: k
Common Teamcenter Server Bottleneck Causes6 \0 H% \, J. ?' S% G
• Overloaded Tc Servers- N3 P9 C; r+ F/ [& v
• Poor Web Tier Configuration
' v9 o, u: V/ V e) q• Poor FMS Configuration
1 Y9 n/ n8 {# r• Debugging Turned ON8 v6 u; X9 I: m6 Z0 h
• Rich Client using OOTB settings
' X; ]" V2 L& X1 D& q# k‘Unload’ Overloaded Teamcenter Servers
1 z8 f2 a6 k! L0 e. d; p. y• Put Dispatcher modules on separate computers away from other Tc Servers.
0 p+ l- H3 e) B• Separate the Web & Enterprise tiers from the Tc Corporate and Volume servers.
# O: `% ~( O, c! } ^• Use load balancing for Middle Tier & FMS:
/ @2 X# E" v9 y9 eo Use multiple Web/Enterprise Tier servers to open up potential hardware resource bottlenecks (e.g. CPU, RAM, network adapter I/O, disk I/O, MB bus, etc.).7 f0 V G% f- F2 g- \6 ?, |
o Set up multiple FSC cache servers to take load off busy volume servers/storage.
, k+ B% ~% J E4 xWeb Tier Configuration& k" ]8 o5 [# U4 a
• Do not use port 80 or 80803 \6 c4 M& W% K: V+ V; v5 n9 Y- N
o HTTP traffic on those ports is considered web browsing traffic and is therefore given lowest priority on any network. Can also cause randomly dropped connections.; L' k$ P6 Z K0 | F* o/ _
• Enable http compression if not using WAN acceleration$ \; e( @* Z: E$ t( e8 k
o Must be done on both web server and on clients to take effect.# T( |2 I9 @8 X# ^, f; j
• Change/tune OOTB settings for Web Server/App- N( c. Z5 N4 P6 k ^' ~% F; l
o E.g. timeout values, max # of threads, Java memory, etc.$ F. x7 p" L+ q+ J n* N
o Read tuning guides specific to your chosen web server/app) Y0 W& y. e/ d+ \( Z3 Q0 M
• Scale it up or sideways
B8 y- D* y2 uo Add another web tier server, or increase # of work processes (e.g. Web Garden mode for IIS)." H/ M# \4 i1 Z. U8 R9 C
Common FMS Bottleneck Causes( ]3 Q/ k/ P6 ~9 b/ y* k* o8 j
• Data improperly routed: A- C# H/ c j# d3 t. \6 ?. R
o E.g. Forcing data to go through a remote FSC server over a WAN and back again over the same WAN instead of simply pulling it directly from a nearby Volume/cache server.
; b# ^$ t/ A, S% n+ a. y4 X% e" I• Using OOTB settings
. Z2 P) X) c( po For development purposes only, remember?3 s! F( }3 k! N% {* n% {" X* I4 A4 E
• Missing client IP address subnets% z$ ] s; N9 K3 e S
• No load balancing' [8 l6 Q7 R( ]5 p4 K5 ^) B
• Not using remote cache servers for WAN users
( _0 ?3 u* K- V& i• Not using remote volume servers for WAN users
( @* P! M: i- s2 a$ H0 ?) c4 ZFMS Configuration
; ?4 u' W" [) H3 x0 _• Ensure routing is correct
. p( P7 M6 J0 v( j. b. l+ Qo Between multiple FSC groups via entry/exit/link parameters; f* g- N5 P7 J- ?+ B" y0 A% p
o Between clients and their assigned FSC servers by using complete and accurate ‘clientmap’ parameters for ALL clients.$ U- D, r- O9 z/ D% H: i/ Z, m
o Use correct transport algorithms for LAN and WAN users.: @3 D( }) a: ^, v
• Tune FSC/FCC cache settings
: t, Q/ p1 f" v8 Eo Simply picking a total read/write cache size is not enough.
6 P, f7 I' G' m# `# Go Read “Sizing the FMS fast cache” in the Teamcenter help documentation. There is also a FMS cache sizing tool available from the GTAC web site. Link to FMS Calculator
: I) X' J0 A- K2 m6 T8 n8 y. G• Ensure correct client maps
* a4 v6 i7 W/ }' W+ r. v8 N+ j( Ao Determine ALL potential client IP address ranges and where they are located. Don’t forget to account for VPN IP addresses.3 G* g. S9 R4 [0 |5 D
o Place client maps in the closest FSC group to their location.
) c& I& n, f& ]4 F• Use multiple FSCs for load balancing
& Z1 |& L, W3 U* Ro Use “front-end” FSC cache servers to reduce load on Volume servers. (Requires disabling of FSC direct routing)
( [4 h, ?1 y$ y V1 i G: Eo Use redundant FSC cache servers to load balance each other. Also provides fail-over.% A+ g) Q" b1 }) I& z
• Place FSC cache servers close to users
: S6 C4 j1 ~9 o$ s+ T ]. T9 i3 Yo Greatly improves read performance (load time) over a WAN for groups consuming shared data., b3 Y/ v! O- g5 R
• Place Volume servers close to users
# q9 F5 ]) H ?+ {o Use Store & Forward or at least place remote volumes near remote users. (Backups of remote volumes are critical)
! H+ }7 J" f) V% G; h- C/ e Ko Greatly improve write performance (save time) over a WAN especially for CAD data.
! N. e3 M% W( U4 V! x( V5 v• Prepopulate FSC caches! Q/ l+ i: h! t' G: B4 w% }. P9 `" M
o Run a nightly script to prepopulate shared data across FSC caches.
4 B7 Z/ q- B9 C6 A# `6 C+ mMisc Teamcenter Changes: u- O1 J6 ]/ m5 X7 u
• Disable logging and other debugging tools. Turn them on only when needed. Examples,
t( b% R4 @0 R3 U+ S' I: bo TC_SECURITY_LOGGING=OFF2 p, X7 I! K# d. m" A9 ~/ q4 L
o TC_APPLICATION_LOGGING=OFF' b' V y& c3 t# ~4 C
o TC_SLOW_SQL=-1
' A# U/ c4 q* E+ X' i4 D• Rich Client ‘Teamcenter.ini’ configuration:
/ P7 D. d% V8 \9 l' v5 [ Po Modify Teamcenter.ini file to increase Java Memory and other settings. Will improve performance/stability when perform large operations (CAD, PSE expansion, large Workflows).
9 R( f0 x# ?2 A. `6 P• Enable FCC File Warming: K$ K, |6 Q; s4 T6 d0 M
o Improve startup time by having FCC and Tc files pre-loaded at OS login.( |; K% N2 s2 e
Network Performance
3 U j; a; K9 N; |. x• Use a hardware-based WAN accelerator if using Teamcenter between multiple facilities over a WAN.
$ {" c+ R0 W* J0 l0 \o If none then make best use of software-based Web server and FMS WAN acceleration settings. (i.e. http compression & FMS compression)4 M6 }# P0 ]# m s. e
• Optimize OS network settings
0 r; X3 b$ r8 ~4 F3 U/ go OOTB settings are insufficient
" @; R; W5 C$ D6 q/ O' Yo Applies to both servers and clients k4 W8 H; |" b S
o Examples, increasing # of tcp ports, disabling NAGLE algorithm, increasing buffer sizes, trunking multiple NICs, enabling Compound TCP, Large Windows Scaling" X! M& x! g! a$ i
Recommended Server Changes (Windows)5 T4 X5 U: c `8 M
See Presentation.
3 f* s2 i$ H" ^; u+ y4 {Recommended Client Changes (Windows)* U1 @, T6 X- P. s- G1 y' q
See Presentation.8 T5 |* _' n# x: {' F1 W7 W
Performance Monitoring Tools
- C8 P7 u( h* q; r/ x- _$ q O3 T' s% `& j- V• Some useful performance monitoring tools:1 J6 Q$ c- k, Y$ q) ?
• Performance Monitor (comes with Windows): C$ B V! b! {
• Used to monitor OS, Teamcenter, and SQL use of resources
- y1 |8 Q) z* J) ]• Wireshark (freeware network packet sniffer)- f* O2 S. y( _& K3 C. K
• Used to help identify network TCP performance between computers.
/ s4 q1 V I- J5 u• Available at http://www.wireshark.org/* d4 o0 O( m" O2 F# B/ o
• Sysinternals Suite (free from Microsoft web site)
, Q' @/ }( i: g/ ?' d2 {• http://technet.microsoft.com/en-us/sysinternals/bb842062
8 ~* ]) A4 m# j$ e1 AReference Materials* V& @3 m% i0 u2 l0 h; n
• Available on GTAC Web Site @ http://support.industrysoftware.automation.siemens.com/docs/teamcenter/
1 v6 J9 s, U- t' h9 Do Teamcenter Deployment Guide( k6 d# u: {+ N( b; g% |( D
o Teamcenter Network Performance Tuning4 ^; J! P% z* e- t. a
o JBoss 4.2.2 Installation & Tuning Guide
6 Q" `: c! i* ]( y$ A. M" yo Optimizing Teamcenter Client Performance
5 K1 D; g5 c! @) c0 Vo Teamcenter System Performance Analysis: D( V- t/ [! x
• Oracle documentation & web sites* j2 V. X, l* M; D$ d% r7 R: W0 M
• MS SQL Server documentation in addition to:
! R) `( ]+ z: _" O, W: H5 @o Best Practices for Running Siemens Teamcenter on SQL Server
; Z) X) r$ A+ x: g, v http://download.microsoft.com/download/7/3/6/7365D2BB-BB34-4D28-A128-F2C8FBA6E995/Siemens-Teamcenter-and-SQL-Server-Best-Practices.pdf; u' M( }3 q5 g! s
o Siemens Blog on Technet' I4 C4 z/ M: g) W/ a. s
http://blogs.technet.com/b/sql_server_isv/archive/tags/siemens/% g u* `2 f* L
o Siemens-Teamcenter-SQL-Resource-Page; O) `# n& G9 T6 z' a5 C/ y2 M. x
http://blogs.technet.com/b/sql_server_isv/p/siemens-teamcenter-sql-server-resource-page.aspx
+ T8 p, P" n/ y9 x• Past PLM World Conference Presentations available at www.plmworld.org,- R6 R; U" f' U$ L" w
o Teamcenter 4-Tier Deployment – Best Practices* M+ J# O1 u2 K& R( J$ B7 K
o Teamcenter – Database Performance
0 ^" }& @4 X4 uo JBoss Optimization for Teamcenter
$ D: G1 u7 C L0 \0 F! bo Optimizing Teamcenter Client Performance, E, v5 B; Y& {# k0 a
o Teamcenter Database Server Configuration & Tuning* t- G2 Y) X6 {9 F/ E; Q* p/ S# `
Contact Information( o, x0 l) X; C1 Q. [' p
Larry Carpenter P.E., PLM World Teamcenter SIG Chair, tcua@plmworld.org L; {. k% q! L8 P
Teamcenter UA SIG: http://www.plmworld.org/TC_UA4 B5 P7 P+ t9 R( M
LinkedIn: http://www.linkedin.com/pub/larry-carpenter-pe/44/5b8/aaa* X# I( D) I- o6 [# l9 Q0 T1 k0 J# R
Alternate Contact Info: ideas2nx@plmworld.org, larry.carpenter@siemens.com
. c* s: a2 O! N) k+ q! j+ O5 ^" u1 E# ~8 [7 s* W) O
|
|