|
请使用QQ关联注册PLM之家,学习更多关于内容,更多精彩原创视频供你学习!
您需要 登录 才可以下载或查看,没有账号?注册
x
http://www-cad.fnal.gov/PLMWorld2008/Teamcenter%20Unified/The%2520Network%2520is%2520Slow!.pdf 0 o; ]8 L$ U1 a$ z1 `/ S
http://www.plmworld.org/p/bl/et/blogid=43&blogaid=218
* d- {1 p. F8 dhttps://support.industrysoftware.automation.siemens.com/docs/teamcenter/Network_Performance_Tuning_V6.6.pdf
7 j4 ^7 f% R! B# y* R6 {# H3 Y( k g3 j/ ?% d% c; T" ~: b
Teamcenter is Slow! Teamcenter Performance Bottlenecks & Mitigation
1 I+ g. s. F6 X. G3 b/ F; s/ R; r ' ^0 ^) o9 i' s |: B
Larry Carpenter
) Z& r* Z+ a( x& x6 ?- K0 e# @At the Chicago-Wisconsin RUG Fall Conference in October 2012, I gave a presentation on common Teamcenter performance issues and solutions along with listing, in one place, many other past Teamcenter performance presentations and white papers. It was very well received by a standing room crowd, so I thought I'd share it with the rest of the PLM World community. Here is a link to the presentation (you must be a TCUA SIG member to view it): http://www.plmworld.org/p/do/sd/sid=3758&type=0
) [. O; Z, D% C m! ]8 {' VFor those unwilling to join the TcUA SIG to view it, I wrote an abbreviated version here:4 ?4 x3 o1 |& P, U% _, P
Why Performance Matters
& q2 D; L* R" `6 E• Productivity – doing more work with less" X. c" t4 |2 L6 i) W
o Improve end user productivity+ P$ j# y1 L! Q: K0 {+ N& `, q7 V
o Improves administrator productivity( o( [6 b6 x& d) J( I
fewer help desk calls responding to or fixing preventable problems, c0 o; U/ ]% y9 R" f; P4 u2 R# ~
• Reliability
6 g. b$ j2 d6 @5 Mo A well tuned Teamcenter environment also improves system stability and uptime.) X4 D$ J& q. k6 Z6 v
o Less opportunity for data corruption! |: C9 `/ a( a3 n$ \, u
o Fewer operational errors/problems
: `9 \: k! z2 W$ }5 R' `8 D+ H• Cost Savings& p! p- M- Z- {. f
o Less waiting means less time wasted.
% N9 G% m# F# a. NQuick Case Study: Company ‘S’
. F& X x% z0 |! r FPerformance was so bad that something which used to take 10 minutes was taking 2 hours to do.Did pretty much everything wrong, performance-wise, at first but ultimately fixed every major problem. What took 2 hours now only takes 2 minutes.. n# r# G6 A8 P: v7 t1 v9 C" U( G
See my March 2012 article on PLM World’s website for details:; \2 h1 _" W, D/ I/ p8 [ b
Teamcenter Performance – Hard-Earned Lessons: http://www.plmworld.org/p/bl/ar/blogaid=152
9 @7 N: n% o/ Q- qCommon Performance Bottleneck Causes
* A, R+ j& B; K* D; ~0 fUsing OOTB settings — OOTB settings are intended for development environments; not production environments.
4 V% N$ z1 C& i# h! h3 O3 `. BOverloaded servers — Putting too much on a single server.
% F* z1 ]; [ ?7 [Operating system settings — Network settings most common (e.g. TCP parameters).6 n+ W) K+ f" ?% b1 H0 S4 ~) V3 p
Lack of performance monitoring & tuning — Performance doesn’t improve all by itself. It requires human intervention to determine root cause and address it.; V. c0 x3 ]: @) Z' @) l
Databases – The Most Likely Culprit
- m7 n3 A* v ^1 ?• Database performance is highly sensitive to hardware, software, and DB configuration.
2 V* O+ f) V" N' W- Z; b, D• DBAs at companies generally don’t do performance monitoring and tuning of your Teamcenter DB.
) Z( i: I! [( f9 ~3 C• It’s typically the last place that Teamcenter administrators look for performance issues rather than the first.2 h% ]( n9 N8 W( e+ m" ]% y
Mitigating Database Server Bottlenecks
0 g; l/ I8 }* v/ H _• Must use dedicated DB server
+ c/ N2 Y% v" v- J* Ao Do not use your DB server for anything other than your Teamcenter production database. This includes not serving additional databases from the same server.
4 I: \( d9 ^9 n! t• Must have fast dedicated storage for DB files( w1 o8 R* U# D+ y; @& P
o Avoid using a NAS device; especially a shared NAS. Use DAS (Direct Attached Storage) instead.) S& s1 \; U( _" V
o Use multiple fast disk spindles partitioned with proper RAID levels according to the DB vendor & SPLM recommendations.
: K+ f+ \3 ~6 N$ C/ To Split DB data, temp, and log files across those RAID partitions according to DB vendor & SPLM recommendations.
" v7 x& G0 S9 Bo Use disk controllers with a battery/flash backed cache.
h2 ]7 {+ H+ @0 o" Do Use multiple disk controllers if possible.4 E; ~4 d5 ]( n) [
• Cram the RAM- z4 X: h( u% B9 L- s
o Ideally should be greater than the database size or in-memory footprint. Otherwise disk swapping/paging will occur., G0 Y1 l( A0 f' h2 z
• Use 64-bit OS & DB software
9 D0 T5 M) V6 z" l2 b+ ro 32-bit software has severe limitations regardless of whether you use “/3G”, AWE, or PAE settings to access memory beyond 3-4G. It’s still a bottleneck.- I4 o, x0 C; t s3 O
• Use a good quality network adapter(s)" @/ o p; j" _, o* Y; O* m, `; J
o Often overlooked as potential source of bottleneck (e.g. packets/sec limitations). Consider multiple NICs “trunked” for better throughput.8 M8 f$ E0 k4 n4 R6 c7 P b& q
• DB maintenance tasks$ B6 ~5 m% d7 r! E: z5 G5 v
o Update statistics and rebuild indexes regularly.
: c/ Y* ~. e+ J, O7 ]4 E: p, I, dCommon Teamcenter Server Bottleneck Causes# k* C! m+ @& c3 M& o6 I! M
• Overloaded Tc Servers
, ?6 J& g3 Z e% b, ~8 d• Poor Web Tier Configuration
$ r+ f& t5 h ~! S( ]' X8 p• Poor FMS Configuration
3 P. x! D. e0 o. ?, C• Debugging Turned ON
) |; ^# Q; R2 {' w• Rich Client using OOTB settings
7 E$ E9 k' R' g; G$ j/ h* E‘Unload’ Overloaded Teamcenter Servers% Y' s. u7 l4 I
• Put Dispatcher modules on separate computers away from other Tc Servers.
& Z9 Q L( B: p• Separate the Web & Enterprise tiers from the Tc Corporate and Volume servers.9 H: A3 s. b K8 n, Z; y) r8 c
• Use load balancing for Middle Tier & FMS:
) Q) W/ }9 _: m c9 Do Use multiple Web/Enterprise Tier servers to open up potential hardware resource bottlenecks (e.g. CPU, RAM, network adapter I/O, disk I/O, MB bus, etc.).
: A9 k% P* m) c6 ]* p% q3 ]o Set up multiple FSC cache servers to take load off busy volume servers/storage.7 A! \) F7 f* U/ ^. B
Web Tier Configuration- P2 w" E5 R0 s K
• Do not use port 80 or 80809 y! Z4 G% v) M& v
o HTTP traffic on those ports is considered web browsing traffic and is therefore given lowest priority on any network. Can also cause randomly dropped connections.0 A2 E7 Q3 Z& u& E8 ^1 ^
• Enable http compression if not using WAN acceleration8 C* P4 S. p/ }! A, Y; b, E2 g
o Must be done on both web server and on clients to take effect.$ F( ~; A' @ |) h3 y" _
• Change/tune OOTB settings for Web Server/App3 B R j; x/ f3 M
o E.g. timeout values, max # of threads, Java memory, etc.
- |; r9 E8 J" c5 j: v: eo Read tuning guides specific to your chosen web server/app- M- i# ?8 @+ a$ B. X
• Scale it up or sideways. h2 t$ e" t7 V6 s* C
o Add another web tier server, or increase # of work processes (e.g. Web Garden mode for IIS).8 Z' Z, {( r4 Z I7 T* C% |1 J; d
Common FMS Bottleneck Causes
3 V/ g' r' d: v7 x• Data improperly routed4 h+ D! y7 k; m
o E.g. Forcing data to go through a remote FSC server over a WAN and back again over the same WAN instead of simply pulling it directly from a nearby Volume/cache server.* h- I4 D8 ^' ~
• Using OOTB settings
6 c0 C$ Q! u* J6 ?3 O* ]o For development purposes only, remember?8 k" Y1 h1 _( j7 X4 P! @( P
• Missing client IP address subnets. H- }9 `, `+ t7 n3 A9 k
• No load balancing
0 I2 Y3 m+ r& k5 v5 V* J3 L• Not using remote cache servers for WAN users
+ C5 h, W5 @% P5 D' l4 ]• Not using remote volume servers for WAN users
+ b$ g3 n! E6 I9 B$ ]; I% {FMS Configuration
. z" X, s# M* U• Ensure routing is correct4 l5 f& q) s8 }2 @+ f
o Between multiple FSC groups via entry/exit/link parameters
! G3 g1 Q% M' _9 F, Io Between clients and their assigned FSC servers by using complete and accurate ‘clientmap’ parameters for ALL clients.
7 R4 q/ b& ] j9 x# E9 Ro Use correct transport algorithms for LAN and WAN users.
+ k" f% s: ]- u" M) ~• Tune FSC/FCC cache settings
" [. ?: R+ g0 o9 y3 K! Z4 L. ho Simply picking a total read/write cache size is not enough.
! j2 U' X& |7 V" mo Read “Sizing the FMS fast cache” in the Teamcenter help documentation. There is also a FMS cache sizing tool available from the GTAC web site. Link to FMS Calculator
% H1 E: x. `/ O. [# ^ g7 [• Ensure correct client maps2 A: y: s/ g! O
o Determine ALL potential client IP address ranges and where they are located. Don’t forget to account for VPN IP addresses.
+ J; D% h; r7 ]5 {, d5 {/ f9 Uo Place client maps in the closest FSC group to their location.) Q6 Y3 M0 Q# X8 f7 i: |( E/ j
• Use multiple FSCs for load balancing* }1 u$ P, _1 i' L5 Q% |' @
o Use “front-end” FSC cache servers to reduce load on Volume servers. (Requires disabling of FSC direct routing)
; m, J6 R% H4 Z! W/ w& E% no Use redundant FSC cache servers to load balance each other. Also provides fail-over.
8 V& @! r4 j# M• Place FSC cache servers close to users$ B) {. z2 L) f2 }# n) m" z/ B- K+ i
o Greatly improves read performance (load time) over a WAN for groups consuming shared data.
, ` I/ P; Z+ o; L• Place Volume servers close to users6 k: q7 f/ o5 U3 d! F4 Q0 e( a
o Use Store & Forward or at least place remote volumes near remote users. (Backups of remote volumes are critical)- C% L% e1 A% G6 X9 F
o Greatly improve write performance (save time) over a WAN especially for CAD data.
) Y4 c$ V( T- V& s• Prepopulate FSC caches% c3 Z8 r( C8 _0 [$ A
o Run a nightly script to prepopulate shared data across FSC caches.
c" g8 _) F% P. N4 `/ ?Misc Teamcenter Changes& |, v$ x* I, O- ~' g( k
• Disable logging and other debugging tools. Turn them on only when needed. Examples,# \, {$ @) I# ?% I3 ?/ J
o TC_SECURITY_LOGGING=OFF% V6 B* ? j. f n
o TC_APPLICATION_LOGGING=OFF
7 s* K& Y6 c6 F% F* ~o TC_SLOW_SQL=-1# O, o' q) X y G# z
• Rich Client ‘Teamcenter.ini’ configuration:
6 e* o& y/ Z( Y8 n3 W1 W2 q" Lo Modify Teamcenter.ini file to increase Java Memory and other settings. Will improve performance/stability when perform large operations (CAD, PSE expansion, large Workflows).
' N, G/ Q, n5 e! N* i) a5 P# I• Enable FCC File Warming7 m$ C- G& z2 \4 N5 u
o Improve startup time by having FCC and Tc files pre-loaded at OS login.
/ c6 K" I% q4 \5 l/ t0 NNetwork Performance
1 F- j* V ^4 P9 M$ w• Use a hardware-based WAN accelerator if using Teamcenter between multiple facilities over a WAN.% b9 N7 ~ g- x" t, M4 E% p$ S
o If none then make best use of software-based Web server and FMS WAN acceleration settings. (i.e. http compression & FMS compression)
" O) b# }6 v! y0 S( h; U9 {! K• Optimize OS network settings, |1 p6 |( k3 g e0 d
o OOTB settings are insufficient: D r( u# ? j# U8 t8 z
o Applies to both servers and clients
- ?( D- P9 X# j# X1 j, h0 qo Examples, increasing # of tcp ports, disabling NAGLE algorithm, increasing buffer sizes, trunking multiple NICs, enabling Compound TCP, Large Windows Scaling) L9 }& r0 O' T4 h9 [1 B
Recommended Server Changes (Windows)* ]- O7 K, D4 V z
See Presentation.
# v1 T, {+ B: g, B7 WRecommended Client Changes (Windows)
% U# u- q5 p( r: ^* l0 c+ \See Presentation.% {: p9 @, o8 w6 w3 h2 i
Performance Monitoring Tools
6 L- x R& u8 F' A9 y7 H• Some useful performance monitoring tools:
/ Z1 I' E- T) p( G H• Performance Monitor (comes with Windows)) [2 T* O4 a# U2 L1 R
• Used to monitor OS, Teamcenter, and SQL use of resources
0 I! O! \# u( a4 b• Wireshark (freeware network packet sniffer)" o1 [) e: T& [" L
• Used to help identify network TCP performance between computers.
1 C' I7 v" ~' V1 O1 w" W• Available at http://www.wireshark.org/
) T- _7 f/ a1 f6 c6 _• Sysinternals Suite (free from Microsoft web site)6 Q: n' @& y$ |
• http://technet.microsoft.com/en-us/sysinternals/bb842062
8 x4 e( B* G0 iReference Materials
7 P* @; r+ U J. R( l8 X! t6 e• Available on GTAC Web Site @ http://support.industrysoftware.automation.siemens.com/docs/teamcenter/
; W; R4 x4 |2 E0 c) No Teamcenter Deployment Guide# O9 ^$ b! T+ p3 x
o Teamcenter Network Performance Tuning4 U0 ?, n$ d4 z) i( t
o JBoss 4.2.2 Installation & Tuning Guide
9 `* s$ Q( Z2 Wo Optimizing Teamcenter Client Performance
+ A) g" @: N1 g. Y1 C6 j' ?o Teamcenter System Performance Analysis; v8 q1 N6 X0 G- Z7 M6 u% V
• Oracle documentation & web sites
% m/ t3 K- ?6 r ]4 S2 \• MS SQL Server documentation in addition to:
0 ~# U* o' J& Z0 p9 w. m w0 K; Io Best Practices for Running Siemens Teamcenter on SQL Server
# i* Y; A9 A/ w' `) l% l http://download.microsoft.com/download/7/3/6/7365D2BB-BB34-4D28-A128-F2C8FBA6E995/Siemens-Teamcenter-and-SQL-Server-Best-Practices.pdf
7 ]" k& L6 l( t# Ao Siemens Blog on Technet
+ F& |0 r; [! P+ F. f5 }2 O+ k http://blogs.technet.com/b/sql_server_isv/archive/tags/siemens/* {0 j% r1 ^3 u" O+ t2 V
o Siemens-Teamcenter-SQL-Resource-Page8 v5 h0 d" ? M6 c
http://blogs.technet.com/b/sql_server_isv/p/siemens-teamcenter-sql-server-resource-page.aspx
Y+ O3 {- a- s- r( j ^* h• Past PLM World Conference Presentations available at www.plmworld.org,
" u, }$ Q' y: k% io Teamcenter 4-Tier Deployment – Best Practices9 c) z( Z. Z7 v0 {! l
o Teamcenter – Database Performance
# q5 ?1 N' g! z& X5 co JBoss Optimization for Teamcenter6 c; u* e" _' A& ?! E
o Optimizing Teamcenter Client Performance J+ H/ T, ?# v; }: j& _- ~% T
o Teamcenter Database Server Configuration & Tuning" G' ]7 e1 }2 c t9 b! }
Contact Information
: W! g# }) W3 A0 m9 S8 Z, YLarry Carpenter P.E., PLM World Teamcenter SIG Chair, tcua@plmworld.org1 H3 k- p( Y$ z# ~. J* R/ c
Teamcenter UA SIG: http://www.plmworld.org/TC_UA- f* s6 h/ M( D) h2 _
LinkedIn: http://www.linkedin.com/pub/larry-carpenter-pe/44/5b8/aaa
7 ?1 Y$ V' a& M1 X1 J, _! @, }Alternate Contact Info: ideas2nx@plmworld.org, larry.carpenter@siemens.com
# O8 w2 M8 ]+ h' U; O: {0 g7 s: p8 Q8 E& L$ C- t
|
|